-- Logs begin at Wed 2022-06-29 07:19:48 UTC, end at Wed 2022-06-29 08:26:55 UTC. -- Jun 29 07:53:59.463751 dv-cinder-768105-14-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 29 07:53:59.472829 dv-cinder-768105-14-iscsi devstack@n-api.service[103149]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 29 07:53:59.476148 dv-cinder-768105-14-iscsi devstack@n-api.service[103149]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Jun 29 07:53:59 2022] *** Jun 29 07:53:59.476148 dv-cinder-768105-14-iscsi devstack@n-api.service[103149]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 29 07:53:59.476148 dv-cinder-768105-14-iscsi devstack@n-api.service[103149]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 29 07:53:59.476148 dv-cinder-768105-14-iscsi devstack@n-api.service[103149]: nodename: dv-cinder-768105-14-iscsi Jun 29 07:53:59.476148 dv-cinder-768105-14-iscsi devstack@n-api.service[103149]: machine: x86_64 Jun 29 07:53:59.476148 dv-cinder-768105-14-iscsi devstack@n-api.service[103149]: clock source: unix Jun 29 07:53:59.476148 dv-cinder-768105-14-iscsi devstack@n-api.service[103149]: pcre jit disabled Jun 29 07:53:59.476148 dv-cinder-768105-14-iscsi devstack@n-api.service[103149]: detected number of CPU cores: 4 Jun 29 07:53:59.476148 dv-cinder-768105-14-iscsi devstack@n-api.service[103149]: current working directory: / Jun 29 07:53:59.476148 dv-cinder-768105-14-iscsi devstack@n-api.service[103149]: detected binary path: /usr/bin/uwsgi-core Jun 29 07:53:59.476148 dv-cinder-768105-14-iscsi devstack@n-api.service[103149]: your processes number limit is 47680 Jun 29 07:53:59.476148 dv-cinder-768105-14-iscsi devstack@n-api.service[103149]: your memory page size is 4096 bytes Jun 29 07:53:59.476148 dv-cinder-768105-14-iscsi devstack@n-api.service[103149]: detected max file descriptor number: 2048 Jun 29 07:53:59.476148 dv-cinder-768105-14-iscsi devstack@n-api.service[103149]: lock engine: pthread robust mutexes Jun 29 07:53:59.477647 dv-cinder-768105-14-iscsi devstack@n-api.service[103149]: thunder lock: enabled Jun 29 07:53:59.477647 dv-cinder-768105-14-iscsi devstack@n-api.service[103149]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 29 07:53:59.477647 dv-cinder-768105-14-iscsi devstack@n-api.service[103149]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 29 07:53:59.520620 dv-cinder-768105-14-iscsi devstack@n-api.service[103149]: Python main interpreter initialized at 0x55aefb7529c0 Jun 29 07:53:59.520620 dv-cinder-768105-14-iscsi devstack@n-api.service[103149]: python threads support enabled Jun 29 07:53:59.520620 dv-cinder-768105-14-iscsi devstack@n-api.service[103149]: your server socket listen backlog is limited to 100 connections Jun 29 07:53:59.520620 dv-cinder-768105-14-iscsi devstack@n-api.service[103149]: your mercy for graceful operations on workers is 90 seconds Jun 29 07:53:59.521207 dv-cinder-768105-14-iscsi devstack@n-api.service[103149]: mapped 403077 bytes (393 KB) for 2 cores Jun 29 07:53:59.521207 dv-cinder-768105-14-iscsi devstack@n-api.service[103149]: *** Operational MODE: preforking *** Jun 29 07:53:59.521448 dv-cinder-768105-14-iscsi devstack@n-api.service[103149]: *** uWSGI is running in multiple interpreter mode *** Jun 29 07:53:59.521448 dv-cinder-768105-14-iscsi devstack@n-api.service[103149]: spawned uWSGI master process (pid: 103149) Jun 29 07:53:59.521608 dv-cinder-768105-14-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 29 07:53:59.522156 dv-cinder-768105-14-iscsi devstack@n-api.service[103149]: spawned uWSGI worker 1 (pid: 103150, cores: 1) Jun 29 07:53:59.522494 dv-cinder-768105-14-iscsi devstack@n-api.service[103149]: spawned uWSGI worker 2 (pid: 103151, cores: 1) Jun 29 07:53:59.522647 dv-cinder-768105-14-iscsi devstack@n-api.service[103149]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 29 07:54:00.196540 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 29 07:54:00.197216 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 29 07:54:01.340457 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 29 07:54:01.340457 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: from cryptography.utils import int_from_bytes Jun 29 07:54:01.341172 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 29 07:54:01.341172 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: from cryptography.utils import int_from_bytes Jun 29 07:54:01.346365 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 29 07:54:01.346365 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: from cryptography.utils import int_from_bytes Jun 29 07:54:01.346853 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 29 07:54:01.346853 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: from cryptography.utils import int_from_bytes Jun 29 07:54:03.931085 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 29 07:54:03.931774 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 29 07:54:03.931892 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 29 07:54:03.932215 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 29 07:54:03.932469 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 29 07:54:03.932859 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 07:54:03.933218 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 07:54:03.933544 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 07:54:03.934382 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 07:54:03.934714 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 07:54:03.935027 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 07:54:03.935350 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 07:54:03.935666 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 07:54:03.935997 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 07:54:03.936254 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 07:54:03.936570 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 07:54:03.936892 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-768105-14-iscsi {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 07:54:03.937243 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 07:54:03.937555 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 07:54:03.937868 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 07:54:03.938186 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 07:54:03.938491 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 07:54:03.938810 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 07:54:03.939114 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 07:54:03.939621 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 07:54:03.940078 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 07:54:03.940387 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 07:54:03.940701 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 07:54:03.941057 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 07:54:03.941387 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 07:54:03.941692 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 07:54:03.942010 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 07:54:03.942321 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 07:54:03.942643 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 07:54:03.942953 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 07:54:03.943360 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-768105-14-iscsi {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 07:54:03.943678 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 07:54:03.943994 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 07:54:03.944310 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 07:54:03.944724 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 07:54:03.945059 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 07:54:03.945373 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 07:54:03.945694 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 07:54:03.946018 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 07:54:03.946328 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 07:54:03.946657 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 07:54:03.946977 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 07:54:03.947297 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 07:54:03.947620 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 07:54:03.947923 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 07:54:03.948233 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 07:54:03.948543 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 07:54:03.948861 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 07:54:03.949201 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 07:54:03.950166 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 07:54:03.950426 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 07:54:03.950845 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 07:54:03.951184 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 07:54:03.951513 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 07:54:03.951841 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 07:54:03.952099 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 07:54:03.952355 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 07:54:03.952676 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 07:54:03.953024 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 07:54:03.953350 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 07:54:03.953662 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 07:54:03.953974 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 07:54:03.954287 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 07:54:03.954598 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 07:54:03.954908 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 07:54:03.955219 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 07:54:03.955531 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 07:54:03.955852 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 07:54:03.956170 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 07:54:03.956493 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 07:54:03.956807 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 07:54:03.957156 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 07:54:03.957560 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.43 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 07:54:03.957813 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.43 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 07:54:03.958125 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 07:54:03.958465 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 07:54:03.958787 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 07:54:03.959098 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 07:54:03.959420 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 07:54:03.959742 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 07:54:03.960054 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 07:54:03.960364 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 07:54:03.960673 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 07:54:03.961017 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 07:54:03.961361 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 07:54:03.961668 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 07:54:03.961923 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 07:54:03.962229 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 07:54:03.962549 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 07:54:03.962883 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 07:54:03.963198 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 07:54:03.963507 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 07:54:03.963890 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 07:54:03.964119 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 07:54:03.964429 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 07:54:03.964737 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 07:54:03.965170 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 07:54:03.965683 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 07:54:03.966003 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 07:54:03.966316 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 07:54:03.966627 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 07:54:03.966938 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 07:54:03.967246 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 07:54:03.967572 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 07:54:03.967897 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 07:54:03.968207 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 07:54:03.968514 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 07:54:03.968822 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 07:54:03.969164 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 07:54:03.969492 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 07:54:03.969800 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 07:54:03.970111 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 07:54:03.970434 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 07:54:03.970742 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 07:54:03.971048 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 07:54:03.971370 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 07:54:03.971679 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 07:54:03.971987 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 07:54:03.972306 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 07:54:03.972608 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 07:54:03.972916 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 07:54:03.973268 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 07:54:03.973579 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 07:54:03.973886 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 07:54:03.974191 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 07:54:03.974494 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 07:54:03.974799 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 07:54:03.975103 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 07:54:03.975405 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 07:54:03.975712 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 07:54:03.976013 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 07:54:03.976332 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 07:54:03.976652 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 07:54:03.976967 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 07:54:03.977295 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 07:54:03.977601 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 07:54:03.977924 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 07:54:03.978268 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:03.978602 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:03.978946 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:03.979264 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:03.979599 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:03.979932 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:03.980256 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:03.980575 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:03.980916 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:03.981273 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:03.981589 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:03.981903 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:03.982220 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:03.982538 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:03.982858 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:03.983194 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:03.983515 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:03.983837 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:03.984151 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:03.984465 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:03.984786 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:03.985143 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:03.985472 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:03.985793 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:03.986133 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:03.986477 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:03.986797 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:03.987127 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:03.987457 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:03.987770 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:03.988087 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:03.988400 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:03.988724 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:03.989088 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:03.989407 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:03.989732 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:03.990047 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:03.990364 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:03.990684 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:03.990995 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:03.991310 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:03.991649 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:03.991968 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:03.992290 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:03.992609 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:03.992922 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:03.993269 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:03.993586 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:03.993900 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:03.994210 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:03.994518 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:03.994829 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:03.995143 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:03.995451 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:03.995779 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:03.996110 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:03.996935 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:03.997299 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:03.997782 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:03.998103 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:03.998417 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:03.998734 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:03.999048 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:03.999364 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:03.999679 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:03.999991 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.000316 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.000631 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.000943 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.001293 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.001605 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.001914 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.002287 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.002544 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.002857 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.003172 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.003491 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.003818 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.004135 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.004449 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.004787 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.005155 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.005466 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.005793 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.006119 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.006441 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.006749 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.007063 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.007371 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.007678 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.007985 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.008297 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.008603 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.008912 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.009253 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.009562 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.009869 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.010192 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.010509 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.010814 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.011120 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.011425 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.011769 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.012851 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.013250 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.013600 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.013927 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.014258 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.014577 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.014901 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.015218 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.015536 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.015865 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.016457 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.016902 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.017271 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.017605 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.017928 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.018267 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.018584 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.018911 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.019225 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.019547 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.019893 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.020229 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.020549 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.020875 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.021217 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.021537 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.021851 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.022166 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.022479 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.022793 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.023117 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.023438 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.023758 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.024071 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.024397 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.024711 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.025057 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.025367 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.025686 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.026018 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.026355 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.026670 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.026984 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.027308 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.027682 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.027990 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.028306 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.028617 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.028925 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.029265 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.029582 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.029896 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.030209 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.030520 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.030838 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.031152 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.031463 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.031770 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.032089 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.032416 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.032730 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.033107 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.033451 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.033620 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 29 07:54:04.034031 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.034111 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 29 07:54:04.034195 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.034374 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.034689 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.034823 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 29 07:54:04.034998 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.035306 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.035391 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 29 07:54:04.035615 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.035754 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 29 07:54:04.035964 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.036275 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.036358 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 07:54:04.036584 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.036828 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 07:54:04.036922 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.037244 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.037353 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 07:54:04.037557 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.037862 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 07:54:04.037945 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.038178 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.038366 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 07:54:04.038496 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.038824 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.038965 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 07:54:04.039128 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.039338 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 07:54:04.039428 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.039743 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.039826 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 07:54:04.040057 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.040332 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 07:54:04.040425 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.040668 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.040762 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 07:54:04.041009 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.041245 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 07:54:04.041331 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.041630 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.041765 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-768105-14-iscsi {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 07:54:04.041944 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.042255 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.042364 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 07:54:04.042565 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.042737 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 07:54:04.042886 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.043261 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 07:54:04.043697 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.043792 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 07:54:04.044046 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.044275 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 07:54:04.044363 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.044687 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.044778 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 07:54:04.045042 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.045281 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 07:54:04.045377 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.045696 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.046031 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.046127 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 07:54:04.046381 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.046613 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 07:54:04.046707 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.047252 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.047371 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 07:54:04.047564 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.047859 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 07:54:04.047946 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.048177 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.048381 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 07:54:04.048488 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.048800 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.048897 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 07:54:04.049136 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.049392 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 07:54:04.049477 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.049749 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.049902 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 07:54:04.050060 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.050372 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.050464 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 07:54:04.050682 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.050874 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 07:54:04.051000 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.051310 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.051394 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 07:54:04.051628 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.051936 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.052026 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-768105-14-iscsi {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 07:54:04.052278 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.052450 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 07:54:04.052576 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.052886 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.053000 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 07:54:04.053222 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.053473 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 07:54:04.053559 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.053864 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.054132 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 07:54:04.054230 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.054496 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.054620 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 07:54:04.054828 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.055121 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 07:54:04.055213 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.055469 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.055623 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 07:54:04.055778 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.056106 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.056200 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 07:54:04.056415 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.056615 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 07:54:04.056722 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.057051 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.057176 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 07:54:04.057365 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.057676 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.057762 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 07:54:04.057982 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.058173 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 07:54:04.058294 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.058603 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.058699 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 07:54:04.059498 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.059700 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 07:54:04.059854 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.060104 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.060209 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 07:54:04.060416 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.060669 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 07:54:04.060800 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.061052 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.061203 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 07:54:04.061371 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.061678 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.061771 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 07:54:04.061985 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.062160 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 07:54:04.062300 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.062563 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 07:54:04.062650 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.062905 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.063055 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 07:54:04.063218 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.063527 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.063629 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 07:54:04.063846 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.064037 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 07:54:04.064153 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.064459 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.064598 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 07:54:04.064764 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.064919 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 07:54:04.065100 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.065349 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 07:54:04.065441 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.065703 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.065857 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 07:54:04.066028 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.066341 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.066426 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 07:54:04.066648 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.066833 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 07:54:04.066954 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.067267 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.067350 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 07:54:04.067575 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.067777 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 07:54:04.067873 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.068181 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.068272 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 07:54:04.068507 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.068727 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 07:54:04.068825 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.069153 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.069255 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 07:54:04.069469 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.069728 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 07:54:04.069813 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.070068 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.070223 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 07:54:04.070374 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.070685 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.070768 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 07:54:04.070990 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.071209 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 07:54:04.071301 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.071589 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.071719 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 07:54:04.071895 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.072201 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.072286 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 07:54:04.072526 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.072705 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 07:54:04.072841 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.073175 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.073378 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.43 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 07:54:04.073513 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.073783 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.073875 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.43 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 07:54:04.074127 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.074280 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 07:54:04.074485 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.075344 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.075501 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 07:54:04.075647 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.075890 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 07:54:04.075985 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.076263 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.076351 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 07:54:04.076578 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.076853 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 07:54:04.076947 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.077224 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.077378 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 07:54:04.077534 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.077854 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.077940 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 07:54:04.078170 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.078330 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 07:54:04.078488 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.078800 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.078885 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 07:54:04.079110 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.079308 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 07:54:04.079435 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.079751 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.079843 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 07:54:04.080067 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.080307 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 07:54:04.080398 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.080706 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.080795 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 07:54:04.081056 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.081227 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 07:54:04.081369 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.081686 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.081772 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 07:54:04.082001 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.082218 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 07:54:04.082303 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.082615 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.082711 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 07:54:04.082929 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.083191 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 07:54:04.083286 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.083550 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.083687 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 07:54:04.083867 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.084165 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 07:54:04.084249 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.084482 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.084644 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 07:54:04.084793 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.085138 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.085305 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 07:54:04.085452 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.085757 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.085935 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 07:54:04.086084 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.086245 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 07:54:04.086398 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.086727 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 07:54:04.086911 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.087201 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 07:54:04.087359 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.087540 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.087675 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 07:54:04.087854 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.088155 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 07:54:04.088296 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.088594 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.088739 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 07:54:04.088911 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.089175 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 07:54:04.089318 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.089552 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.089704 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 07:54:04.089843 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.090201 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 07:54:04.090351 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.090698 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 07:54:04.090859 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.091161 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.091302 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 07:54:04.091476 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.091661 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 07:54:04.091904 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.092176 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 07:54:04.092436 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.092577 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.092709 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 07:54:04.092909 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.093168 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.093326 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 07:54:04.093461 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.093751 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 07:54:04.093900 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.094079 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.094215 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 07:54:04.094391 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.094695 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 07:54:04.094841 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.094997 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.095182 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 07:54:04.095325 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.095623 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.095750 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 07:54:04.095948 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.096116 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 07:54:04.096369 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.096761 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 07:54:04.096864 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.097015 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.097106 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 07:54:04.097415 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.097561 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 07:54:04.097732 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.098048 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.098131 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 07:54:04.098544 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 07:54:04.098629 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.099033 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 07:54:04.099168 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.099523 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 07:54:04.099746 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.100014 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 07:54:04.100297 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.100504 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 07:54:04.100883 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.101031 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 07:54:04.101512 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.101606 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 07:54:04.101985 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 07:54:04.102094 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.102453 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 07:54:04.102688 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.102943 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 07:54:04.103291 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.103432 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 07:54:04.103901 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.103996 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 07:54:04.104291 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.104376 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 07:54:04.104635 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.104845 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 07:54:04.104990 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.105439 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 07:54:04.105971 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.106521 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.106614 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.106947 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.107159 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.107380 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.107720 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.107811 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.108047 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.108370 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.108469 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.108987 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.109454 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.109548 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.109785 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.110054 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.110144 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.110416 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.110579 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.110735 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.111053 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.111147 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.111391 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.111636 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.112160 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.112691 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.113254 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.113794 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.113898 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.114191 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.114377 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.114526 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.114856 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.114987 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.115177 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.115500 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.115584 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.115838 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.116157 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.116241 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.116496 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.116789 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.116880 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.117234 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.117415 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.117567 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.118017 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.118564 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.119091 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.119642 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.119875 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.120193 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.120289 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.120537 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.120781 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.121118 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.121856 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.122130 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.122459 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.122630 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.123002 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.123105 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.123588 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.123684 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.123969 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.124087 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.124324 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.124631 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.124724 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.125006 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.125235 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.125475 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.125800 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.125946 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.126279 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.126371 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.126700 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.126880 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.127040 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.127359 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.127451 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.127705 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.127942 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.128036 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.128357 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.128676 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.128767 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.129007 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.129321 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.129417 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.129638 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.129878 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.129971 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.130253 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.130419 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.130581 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.130893 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.130978 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.131220 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.131481 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.131572 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.131830 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.132020 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.132163 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.132490 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.132634 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.132781 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.133088 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.133176 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.133454 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.133623 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.133779 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.134109 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.134240 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.134445 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.134764 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.134871 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.135090 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.135394 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.135499 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.135722 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.135909 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.136047 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.136369 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.136456 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.136690 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.137577 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.137693 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.137950 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.138156 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.138424 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.138664 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.138852 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.139185 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.139278 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.139513 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.139688 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.140094 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.140181 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.140435 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.140680 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.140773 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.141099 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.141233 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.141423 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.141730 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.141826 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.142056 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.142235 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.142375 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.142695 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.142780 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.143058 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.143214 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.143408 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.143653 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.143741 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.143982 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.144254 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.144359 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.144641 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.144771 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.144967 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.145312 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.145399 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.145634 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.145849 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.145955 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.146315 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.146404 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.146638 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.146869 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.146953 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.147262 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.147385 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.147582 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.147904 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.147989 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.148219 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.148420 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.148536 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.148857 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.148951 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.149204 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.149510 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.149594 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.149830 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.150032 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.150151 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.150472 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.150555 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.150801 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.151102 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.151196 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.151451 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.151655 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.151769 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.152093 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.152208 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.152414 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.152749 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.153086 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.153323 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.153417 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.153735 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.153833 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.154064 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.154352 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.154436 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.154701 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.154877 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.155025 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.155356 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.155440 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.155669 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.155908 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.156001 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.156280 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.156420 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.156593 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.156922 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.157050 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.157257 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.157471 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.157558 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.157868 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.157983 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.158192 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.158492 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.158576 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.159012 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.159114 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.159368 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.159523 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.159693 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.160025 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.160108 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.160353 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.160522 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.160675 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.161001 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.161088 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.161337 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.161587 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.161672 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.161945 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.162105 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.162266 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.162581 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.162672 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.162890 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.163167 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.163252 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.163497 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.163730 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.163826 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.164126 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.164279 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.164409 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.164717 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.164808 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.165067 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.165369 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.165456 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.165675 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.165903 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.165995 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.166280 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.166447 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.166587 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.166894 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.166977 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.167202 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.167507 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.167637 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.167820 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.168033 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.168163 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.168563 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.168670 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.168872 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.169214 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.169390 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.169532 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.169845 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.169942 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.170199 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.170395 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.170524 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.170833 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.170922 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.171139 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.171427 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.171513 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.171761 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.172186 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.172338 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.172652 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.172741 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.172964 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.173239 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.173325 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.173645 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.173830 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.174181 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.174336 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.174515 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.174836 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.175003 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.175172 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.175398 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.175489 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.175802 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.175940 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.176112 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.176421 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.176513 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.176747 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.177023 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.177125 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.177393 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.177524 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.177706 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.178022 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.178107 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.178338 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.178554 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.178639 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.178950 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.179059 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.179268 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.179579 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.179664 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.179889 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.180098 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.180202 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.180515 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.180607 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.180828 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.181203 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.181296 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.181499 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.181693 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.181820 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.182139 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.182221 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.182459 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.182722 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.182819 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.183075 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.183233 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.183387 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.183699 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.184316 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.184515 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.184834 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.184939 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.185190 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.185434 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.185520 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.185802 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.186083 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.186224 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.186538 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.186629 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.186859 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.187121 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.187219 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.187484 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.187637 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.187807 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.188133 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.188230 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.188448 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.188665 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.188757 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.189096 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.189218 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.189435 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.189750 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.189846 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.190093 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.190275 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.190420 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.190730 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.190823 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.191038 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.191297 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.191382 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.191645 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.191815 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.191967 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.192281 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.192375 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.192589 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.192886 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.193017 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.193222 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.193370 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.193529 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.193837 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.193921 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.194144 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.194380 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.194472 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.194748 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.194892 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.195052 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.195358 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.195443 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.195662 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.195933 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.196017 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.196260 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.196465 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.196549 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.196857 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.197024 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.197187 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.197494 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.197580 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.197796 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.198038 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.198130 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.198391 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.198581 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.198723 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.199056 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.199140 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.199403 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.200223 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.200322 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.200536 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.200773 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.200858 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.201187 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.201321 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.201510 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.201834 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.201926 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.202152 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.202429 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.202524 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.202785 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.202948 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.203099 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.203414 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.203505 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.203727 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.203998 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.204089 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.204338 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.204522 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.204652 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.205001 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.205088 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.205335 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.205603 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.205688 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.205960 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.206131 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.206279 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.206602 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.206688 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.206921 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.207179 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.207265 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.207556 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.207687 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.207871 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.208185 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.208277 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.208503 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.208714 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.208806 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.209149 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.209251 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.209470 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.209779 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.209866 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.210106 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.210314 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.210435 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.210751 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.210836 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.211083 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.211346 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.211440 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.211746 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.211874 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.212062 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.212387 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.212472 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.212726 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.212908 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.213067 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.213385 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.213481 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.213695 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.213944 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103150) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 29 07:54:04.214376 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.214967 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.215938 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.216285 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.216628 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.216995 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.217344 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.217689 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.218053 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.218375 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.218701 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.219021 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.219340 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.219663 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.219982 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.220302 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.220618 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.220940 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.221284 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.221599 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.221914 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.222228 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.222554 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.222866 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.223204 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.223499 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.223830 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.224146 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.224458 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.224770 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.225103 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.225456 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.225777 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.226122 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.226456 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.226806 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.227120 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.227432 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.227850 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.228417 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.228417 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.229216 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.229216 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.229504 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.229594 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.229907 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.230223 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.230541 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.231589 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.231906 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.232235 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.232612 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.232875 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.233221 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.233534 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.233847 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.234169 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.234486 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.234800 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.235118 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.235429 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.235934 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.236255 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.236569 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.236883 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.237225 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.237544 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.237856 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.238186 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.238505 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.238818 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.239133 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.239450 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.239762 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.240071 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.240386 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.240714 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.241062 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.241373 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.241687 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.241998 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.242310 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.242619 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.242932 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.243239 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.243547 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.243855 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.244165 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.244475 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.244801 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.245141 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.245451 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.245767 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.246075 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.246471 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.246784 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.247149 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.247462 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.247783 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.248105 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.248421 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.248738 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.249082 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.249393 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.249713 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.250027 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.250343 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.250701 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.250962 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.251287 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.251603 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.251917 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.252242 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.252568 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.252896 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.253229 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.253545 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.253859 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.254172 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.254485 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.254798 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.255112 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.255428 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.255748 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.256062 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.256376 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.256686 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.257020 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.257337 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.257646 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.257976 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.258291 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.258599 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.258911 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.259218 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.259530 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.259839 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.260284 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.260600 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.260917 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.261250 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.261568 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.261923 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.262256 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.262575 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.264598 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.264598 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.264598 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.264598 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.264598 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.264598 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.265127 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.265127 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.265438 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.265760 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.266071 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.266384 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.266713 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.267027 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.267354 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.267781 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.268099 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.268413 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.268837 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.269189 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.269509 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.269838 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.270166 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.270496 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.270810 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.271134 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.271450 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.271780 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.272110 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.272429 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.272754 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.273088 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.273421 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.273753 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.274074 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.274403 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.274844 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.275176 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.275499 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.275838 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.276172 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.276487 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.276801 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.277152 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.277482 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.278408 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.278746 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.279221 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.279545 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.279864 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.280181 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.280495 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.280814 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.281187 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.281499 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.281830 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.282155 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.282484 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.282819 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.283129 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.283459 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.283792 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.284089 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.284401 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.284710 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.285095 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.285414 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.285764 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.286089 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.286427 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.286860 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.287210 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.287549 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.287881 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.288207 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.288538 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.288849 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.289186 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.289502 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.289814 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.290128 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.290438 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.290753 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.291061 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.291371 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.291681 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.292012 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.292323 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.292649 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.293949 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.293949 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.294350 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.294670 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.295025 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.295340 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.295683 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.296019 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.296347 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.296684 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.297277 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.297611 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.297937 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.298260 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.298580 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.298904 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.299219 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.299543 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.299867 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.300185 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.300503 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.300822 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.301183 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.301772 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.302113 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.302432 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.302750 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.303071 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.303384 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.303701 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.304018 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.304333 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.304650 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.304966 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.305327 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.305657 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.305995 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.306339 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.306667 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.306990 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.307311 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.307630 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.307996 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.308322 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.308635 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.309049 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.309378 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.309700 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.310045 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.310330 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.310652 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.310974 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.311294 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.311615 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.311929 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.312249 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.312592 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.312936 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.313291 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.313611 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.313934 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.314255 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.314838 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.315165 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.315506 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.315846 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.316170 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.316493 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.316825 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.317192 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.317506 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.317819 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.318141 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.318455 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.318772 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.319105 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.319414 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.319725 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.320051 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.320367 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.320965 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.321352 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.321679 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.322015 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.322341 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.322668 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.322983 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.323313 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.323623 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.324019 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.324261 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.325155 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.325470 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.325779 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.326154 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.326486 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.326712 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.327027 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.327335 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.327669 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.327980 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.328287 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.328595 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.328914 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.329257 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.329566 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.329883 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.330190 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.330512 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.330822 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.331139 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.331450 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.331766 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.332074 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.332418 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.332747 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.333112 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.333426 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.333736 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.334063 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.334383 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.334714 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.335029 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.335344 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.335705 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.336028 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.336636 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.336996 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.337321 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.337669 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.337998 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.338311 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.338628 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.338936 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.339265 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.339580 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.339896 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.340942 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.341194 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.341518 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.341835 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.342155 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.342472 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.342782 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.343101 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.343416 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.343731 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.344046 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.344369 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.344722 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.345078 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.345407 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.345728 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.346048 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.346388 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.346682 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.346998 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.347320 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.347641 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.347979 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.348296 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.348603 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.349063 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.349392 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.349720 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.350045 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.350364 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.350689 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.351017 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.351327 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.351656 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.351980 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.352315 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.352667 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.353027 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.353351 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.353664 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.353977 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.354290 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.354604 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.354934 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.355255 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.355567 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.355943 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.356262 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.356571 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.356885 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.357238 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.357550 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.357862 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.358170 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.358484 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.358792 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.359101 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.359412 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.359717 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.360029 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.360335 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.360646 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.360952 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.361280 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.361588 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.361933 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.362269 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.362588 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.362923 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.363236 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.363560 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.363870 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.364196 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.364517 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.364845 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.365183 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.365528 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.365839 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.366159 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.366478 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.366793 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.367114 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.367315 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: INFO dbcounter [None req-1fe42089-48ee-4066-a73a-4daf3f2c7573 None None] Registered counter for database nova_api Jun 29 07:54:04.367512 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.367753 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.368083 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.368395 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.368725 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.369074 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.369401 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.369731 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.370048 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.370382 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.370691 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.371005 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.371386 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.371702 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.372019 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.372344 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.372663 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.373036 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.373348 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.373665 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.373997 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.374328 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.374678 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.374995 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.375343 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.375674 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.375992 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.376313 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.376623 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 07:54:04.376872 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103151) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 29 07:54:04.391603 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG oslo_db.sqlalchemy.engines [None req-1fe42089-48ee-4066-a73a-4daf3f2c7573 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103150) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 29 07:54:04.398544 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG dbcounter [-] [103150] Writer thread running {{(pid=103150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 29 07:54:04.470260 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.context [None req-1fe42089-48ee-4066-a73a-4daf3f2c7573 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),dbb7898a-7253-4700-b659-bf676ac566bb(cell1) {{(pid=103150) load_cells /opt/stack/nova/nova/context.py:464}} Jun 29 07:54:04.474587 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG oslo_concurrency.lockutils [None req-1fe42089-48ee-4066-a73a-4daf3f2c7573 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 07:54:04.476864 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG oslo_concurrency.lockutils [None req-1fe42089-48ee-4066-a73a-4daf3f2c7573 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 07:54:04.477802 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG oslo_concurrency.lockutils [None req-1fe42089-48ee-4066-a73a-4daf3f2c7573 None None] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 07:54:04.479888 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG oslo_concurrency.lockutils [None req-1fe42089-48ee-4066-a73a-4daf3f2c7573 None None] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 07:54:04.484951 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: INFO dbcounter [None req-1fe42089-48ee-4066-a73a-4daf3f2c7573 None None] Registered counter for database nova_cell0 Jun 29 07:54:04.490063 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: INFO dbcounter [None req-1fe42089-48ee-4066-a73a-4daf3f2c7573 None None] Registered counter for database nova_cell1 Jun 29 07:54:04.499912 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG oslo_db.sqlalchemy.engines [None req-1fe42089-48ee-4066-a73a-4daf3f2c7573 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103150) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 29 07:54:04.501933 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG oslo_db.sqlalchemy.engines [None req-1fe42089-48ee-4066-a73a-4daf3f2c7573 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103150) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 29 07:54:04.510931 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG dbcounter [-] [103150] Writer thread running {{(pid=103150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 29 07:54:04.513652 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG dbcounter [-] [103150] Writer thread running {{(pid=103150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 29 07:54:04.536948 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: INFO dbcounter [None req-43443468-f4c4-4e75-9e43-8a6d6ae1be39 None None] Registered counter for database nova_api Jun 29 07:54:04.557316 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG oslo_db.sqlalchemy.engines [None req-43443468-f4c4-4e75-9e43-8a6d6ae1be39 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103151) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 29 07:54:04.564085 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG dbcounter [-] [103151] Writer thread running {{(pid=103151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 29 07:54:04.621400 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.context [None req-43443468-f4c4-4e75-9e43-8a6d6ae1be39 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),dbb7898a-7253-4700-b659-bf676ac566bb(cell1) {{(pid=103151) load_cells /opt/stack/nova/nova/context.py:464}} Jun 29 07:54:04.625452 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG oslo_concurrency.lockutils [None req-43443468-f4c4-4e75-9e43-8a6d6ae1be39 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 07:54:04.627086 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG oslo_concurrency.lockutils [None req-43443468-f4c4-4e75-9e43-8a6d6ae1be39 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 07:54:04.627908 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG oslo_concurrency.lockutils [None req-43443468-f4c4-4e75-9e43-8a6d6ae1be39 None None] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 07:54:04.629928 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG oslo_concurrency.lockutils [None req-43443468-f4c4-4e75-9e43-8a6d6ae1be39 None None] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103151) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 07:54:04.631942 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: INFO dbcounter [None req-43443468-f4c4-4e75-9e43-8a6d6ae1be39 None None] Registered counter for database nova_cell0 Jun 29 07:54:04.638399 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: INFO dbcounter [None req-43443468-f4c4-4e75-9e43-8a6d6ae1be39 None None] Registered counter for database nova_cell1 Jun 29 07:54:04.646685 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG oslo_db.sqlalchemy.engines [None req-43443468-f4c4-4e75-9e43-8a6d6ae1be39 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103151) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 29 07:54:04.650075 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG oslo_db.sqlalchemy.engines [None req-43443468-f4c4-4e75-9e43-8a6d6ae1be39 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103151) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 29 07:54:04.654132 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG dbcounter [-] [103151] Writer thread running {{(pid=103151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 29 07:54:04.665408 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: INFO dbcounter [None req-1fe42089-48ee-4066-a73a-4daf3f2c7573 None None] Registered counter for database nova_cell0 Jun 29 07:54:04.680091 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG oslo_db.sqlalchemy.engines [None req-1fe42089-48ee-4066-a73a-4daf3f2c7573 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103150) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 29 07:54:04.686243 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG dbcounter [-] [103150] Writer thread running {{(pid=103150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 29 07:54:04.799443 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG dbcounter [-] [103151] Writer thread running {{(pid=103151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 29 07:54:04.810924 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: INFO dbcounter [None req-43443468-f4c4-4e75-9e43-8a6d6ae1be39 None None] Registered counter for database nova_cell0 Jun 29 07:54:04.820519 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG oslo_db.sqlalchemy.engines [None req-43443468-f4c4-4e75-9e43-8a6d6ae1be39 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103151) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 29 07:54:04.828612 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG dbcounter [-] [103151] Writer thread running {{(pid=103151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 29 07:54:05.042811 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: WARNING keystonemiddleware.auth_token [None req-1fe42089-48ee-4066-a73a-4daf3f2c7573 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 29 07:54:05.050809 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: WARNING keystonemiddleware.auth_token [None req-1fe42089-48ee-4066-a73a-4daf3f2c7573 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 29 07:54:05.184380 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: WARNING keystonemiddleware.auth_token [None req-43443468-f4c4-4e75-9e43-8a6d6ae1be39 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 29 07:54:05.198028 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: WARNING keystonemiddleware.auth_token [None req-43443468-f4c4-4e75-9e43-8a6d6ae1be39 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 29 07:54:05.400709 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: WARNING keystonemiddleware.auth_token [None req-1fe42089-48ee-4066-a73a-4daf3f2c7573 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 29 07:54:05.407430 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: WARNING keystonemiddleware.auth_token [None req-1fe42089-48ee-4066-a73a-4daf3f2c7573 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 29 07:54:05.412685 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55aefb7529c0 pid: 103150 (default app) Jun 29 07:54:05.414799 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi [None req-1fe42089-48ee-4066-a73a-4daf3f2c7573 None None] Calling method '>' {{(pid=103150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 07:54:05.415996 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: INFO nova.api.openstack.requestlog [None req-1fe42089-48ee-4066-a73a-4daf3f2c7573 None None] 10.222.0.43 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001760 Jun 29 07:54:05.416410 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: [pid: 103150|app: 0|req: 1/1] 10.222.0.43 () {50 vars in 788 bytes} [Wed Jun 29 07:54:05 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 07:54:05.668292 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: WARNING keystonemiddleware.auth_token [None req-43443468-f4c4-4e75-9e43-8a6d6ae1be39 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 29 07:54:05.675124 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: WARNING keystonemiddleware.auth_token [None req-43443468-f4c4-4e75-9e43-8a6d6ae1be39 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 29 07:54:05.680434 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55aefb7529c0 pid: 103151 (default app) Jun 29 07:55:25.879191 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi [None req-1fe42089-48ee-4066-a73a-4daf3f2c7573 None None] Calling method '>' {{(pid=103150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 07:55:25.880786 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: INFO nova.api.openstack.requestlog [None req-1fe42089-48ee-4066-a73a-4daf3f2c7573 None None] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.004377 Jun 29 07:55:25.881295 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: [pid: 103150|app: 0|req: 2/2] 10.222.0.43 () {54 vars in 930 bytes} [Wed Jun 29 07:55:25 2022] GET /compute/v2.1 => generated 388 bytes in 6 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 07:55:25.907525 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG dbcounter [-] [103151] Writing DB stats nova_api:SELECT=3 {{(pid=103151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 07:55:25.909224 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG dbcounter [-] [103151] Writing DB stats nova_cell0:SELECT=3 {{(pid=103151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 07:55:25.910670 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG dbcounter [-] [103151] Writing DB stats nova_cell1:SELECT=3 {{(pid=103151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 07:55:25.912156 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG dbcounter [-] [103151] Writing DB stats nova_cell0:SELECT=3 {{(pid=103151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 07:55:26.420888 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi [None req-c0f96250-0875-4795-b436-d1354fba27dd admin admin] Calling method '>' {{(pid=103151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 07:55:26.454970 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: INFO nova.api.openstack.requestlog [None req-c0f96250-0875-4795-b436-d1354fba27dd admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.564520 Jun 29 07:55:26.455720 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: [pid: 103151|app: 0|req: 1/3] 10.222.0.43 () {60 vars in 1291 bytes} [Wed Jun 29 07:55:25 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 07:55:28.815759 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi [None req-1fe42089-48ee-4066-a73a-4daf3f2c7573 None None] Calling method '>' {{(pid=103150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 07:55:28.817472 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: INFO nova.api.openstack.requestlog [None req-1fe42089-48ee-4066-a73a-4daf3f2c7573 None None] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002264 Jun 29 07:55:28.818574 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: [pid: 103150|app: 0|req: 3/4] 10.222.0.43 () {54 vars in 930 bytes} [Wed Jun 29 07:55:28 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 07:55:28.894423 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi [None req-2de85cca-2656-48e6-a350-759c8c299f1c admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "name": "cirros256", "swap": 0, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "c1", "ram": 256, "disk": 1, "rxtx_factor": 1.0}} {{(pid=103151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 07:55:28.917565 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 29 07:55:28.917565 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: warnings.warn(msg) Jun 29 07:55:28.954273 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: INFO nova.api.openstack.requestlog [None req-2de85cca-2656-48e6-a350-759c8c299f1c admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.127571 Jun 29 07:55:28.955438 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: [pid: 103151|app: 0|req: 2/5] 10.222.0.43 () {64 vars in 1282 bytes} [Wed Jun 29 07:55:28 2022] POST /compute/v2.1/flavors => generated 407 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 29 07:55:28.972365 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG dbcounter [-] [103150] Writing DB stats nova_api:SELECT=3 {{(pid=103150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 07:55:28.973826 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG dbcounter [-] [103150] Writing DB stats nova_cell1:SELECT=3 {{(pid=103150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 07:55:28.974851 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG dbcounter [-] [103150] Writing DB stats nova_cell0:SELECT=3 {{(pid=103150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 07:55:28.975774 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG dbcounter [-] [103150] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 07:55:29.218402 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi [None req-265bd741-b81d-4542-b6b5-1b548ebae495 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 07:55:29.220913 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 29 07:55:29.220913 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: warnings.warn(msg) Jun 29 07:55:29.284009 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: INFO nova.api.openstack.requestlog [None req-265bd741-b81d-4542-b6b5-1b548ebae495 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.318696 Jun 29 07:55:29.298618 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: [pid: 103150|app: 0|req: 4/6] 10.222.0.43 () {64 vars in 1335 bytes} [Wed Jun 29 07:55:28 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 07:55:31.900299 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi [None req-2de85cca-2656-48e6-a350-759c8c299f1c admin admin] Calling method '>' {{(pid=103151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 07:55:31.904005 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: INFO nova.api.openstack.requestlog [None req-2de85cca-2656-48e6-a350-759c8c299f1c admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003862 Jun 29 07:55:31.905728 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: [pid: 103151|app: 0|req: 3/7] 10.222.0.43 () {54 vars in 930 bytes} [Wed Jun 29 07:55:31 2022] GET /compute/v2.1 => generated 388 bytes in 7 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 07:55:32.061727 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi [None req-ee0ef5b3-d201-4245-83b6-e1fa9e0dc60b admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds512M", "id": "d1", "ram": 512, "vcpus": 1, "swap": 0, "disk": 5, "rxtx_factor": 1.0}} {{(pid=103150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 07:55:32.080416 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 29 07:55:32.080416 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: warnings.warn(msg) Jun 29 07:55:32.101674 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: INFO nova.api.openstack.requestlog [None req-ee0ef5b3-d201-4245-83b6-e1fa9e0dc60b admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.189087 Jun 29 07:55:32.102236 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: [pid: 103150|app: 0|req: 5/8] 10.222.0.43 () {64 vars in 1282 bytes} [Wed Jun 29 07:55:31 2022] POST /compute/v2.1/flavors => generated 404 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 29 07:55:32.121826 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi [None req-c22a52bd-3587-43dc-85fb-15c7388aaab0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 07:55:32.124041 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 29 07:55:32.124041 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: warnings.warn(msg) Jun 29 07:55:32.167392 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: INFO nova.api.openstack.requestlog [None req-c22a52bd-3587-43dc-85fb-15c7388aaab0 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.050822 Jun 29 07:55:32.168357 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: [pid: 103151|app: 0|req: 4/9] 10.222.0.43 () {64 vars in 1335 bytes} [Wed Jun 29 07:55:32 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 07:55:34.411521 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi [None req-ee0ef5b3-d201-4245-83b6-e1fa9e0dc60b admin admin] Calling method '>' {{(pid=103150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 07:55:34.413001 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: INFO nova.api.openstack.requestlog [None req-ee0ef5b3-d201-4245-83b6-e1fa9e0dc60b admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002078 Jun 29 07:55:34.413788 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: [pid: 103150|app: 0|req: 6/10] 10.222.0.43 () {54 vars in 930 bytes} [Wed Jun 29 07:55:34 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 07:55:34.510188 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi [None req-066160fe-7b1c-41b2-98a8-23bd299701a5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "os-flavor-access:is_public": true, "name": "ds1G", "vcpus": 1, "disk": 10, "ram": 1024, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d2", "swap": 0}} {{(pid=103151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 07:55:34.532586 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: INFO nova.api.openstack.requestlog [None req-066160fe-7b1c-41b2-98a8-23bd299701a5 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.109140 Jun 29 07:55:34.533809 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: [pid: 103151|app: 0|req: 5/11] 10.222.0.43 () {64 vars in 1282 bytes} [Wed Jun 29 07:55:34 2022] POST /compute/v2.1/flavors => generated 404 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 29 07:55:34.546762 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi [None req-cbdcea7c-56f0-4ab6-9966-d2c23006b3b6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 07:55:34.574719 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: INFO nova.api.openstack.requestlog [None req-cbdcea7c-56f0-4ab6-9966-d2c23006b3b6 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032204 Jun 29 07:55:34.585005 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: [pid: 103150|app: 0|req: 7/12] 10.222.0.43 () {64 vars in 1335 bytes} [Wed Jun 29 07:55:34 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 07:55:36.906174 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi [None req-066160fe-7b1c-41b2-98a8-23bd299701a5 admin admin] Calling method '>' {{(pid=103151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 07:55:36.907193 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: INFO nova.api.openstack.requestlog [None req-066160fe-7b1c-41b2-98a8-23bd299701a5 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001445 Jun 29 07:55:36.907602 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: [pid: 103151|app: 0|req: 6/13] 10.222.0.43 () {54 vars in 930 bytes} [Wed Jun 29 07:55:36 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 07:55:36.976546 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi [None req-101f73e9-3389-46c4-a411-c8597986efae admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d3", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "swap": 0, "name": "ds2G", "disk": 10, "vcpus": 2}} {{(pid=103150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 07:55:37.007880 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: INFO nova.api.openstack.requestlog [None req-101f73e9-3389-46c4-a411-c8597986efae admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.094305 Jun 29 07:55:37.009876 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: [pid: 103150|app: 0|req: 8/14] 10.222.0.43 () {64 vars in 1282 bytes} [Wed Jun 29 07:55:36 2022] POST /compute/v2.1/flavors => generated 404 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 29 07:55:37.021663 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi [None req-ea352efd-57b2-4b3d-9362-27694030ab16 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 07:55:37.047558 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: INFO nova.api.openstack.requestlog [None req-ea352efd-57b2-4b3d-9362-27694030ab16 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029287 Jun 29 07:55:37.049073 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: [pid: 103151|app: 0|req: 7/15] 10.222.0.43 () {64 vars in 1335 bytes} [Wed Jun 29 07:55:37 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 07:55:39.222585 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi [None req-101f73e9-3389-46c4-a411-c8597986efae admin admin] Calling method '>' {{(pid=103150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 07:55:39.223602 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: INFO nova.api.openstack.requestlog [None req-101f73e9-3389-46c4-a411-c8597986efae admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001474 Jun 29 07:55:39.224206 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: [pid: 103150|app: 0|req: 9/16] 10.222.0.43 () {54 vars in 930 bytes} [Wed Jun 29 07:55:39 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 07:55:39.290343 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi [None req-ab915761-4c65-4bf1-8710-041b7d4b809d admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds4G", "id": "d4", "os-flavor-access:is_public": true, "disk": 20, "swap": 0, "ram": 4096, "vcpus": 4, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 07:55:39.313035 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: INFO nova.api.openstack.requestlog [None req-ab915761-4c65-4bf1-8710-041b7d4b809d admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.080561 Jun 29 07:55:39.313035 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: [pid: 103151|app: 0|req: 8/17] 10.222.0.43 () {64 vars in 1282 bytes} [Wed Jun 29 07:55:39 2022] POST /compute/v2.1/flavors => generated 404 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 29 07:55:39.326020 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi [None req-2da99a9b-b2ee-4051-a0ef-d8093dec30c7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 07:55:39.352072 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: INFO nova.api.openstack.requestlog [None req-2da99a9b-b2ee-4051-a0ef-d8093dec30c7 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029689 Jun 29 07:55:39.353698 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: [pid: 103150|app: 0|req: 10/18] 10.222.0.43 () {64 vars in 1335 bytes} [Wed Jun 29 07:55:39 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 07:55:41.914598 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi [None req-ab915761-4c65-4bf1-8710-041b7d4b809d admin admin] Calling method '>' {{(pid=103151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 07:55:41.916922 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: INFO nova.api.openstack.requestlog [None req-ab915761-4c65-4bf1-8710-041b7d4b809d admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002723 Jun 29 07:55:41.917427 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: [pid: 103151|app: 0|req: 9/19] 10.222.0.43 () {54 vars in 930 bytes} [Wed Jun 29 07:55:41 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 29 07:55:42.012739 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi [None req-a920105b-076c-4d77-98de-0abcae2cfb8a admin admin] Calling method '>' {{(pid=103150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 07:55:42.059862 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: INFO nova.api.openstack.requestlog [None req-a920105b-076c-4d77-98de-0abcae2cfb8a admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.135299 Jun 29 07:55:42.061154 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: [pid: 103150|app: 0|req: 11/20] 10.222.0.43 () {60 vars in 1291 bytes} [Wed Jun 29 07:55:41 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 07:55:44.494413 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi [None req-ab915761-4c65-4bf1-8710-041b7d4b809d admin admin] Calling method '>' {{(pid=103151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 07:55:44.496006 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: INFO nova.api.openstack.requestlog [None req-ab915761-4c65-4bf1-8710-041b7d4b809d admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002839 Jun 29 07:55:44.496663 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: [pid: 103151|app: 0|req: 10/21] 10.222.0.43 () {54 vars in 930 bytes} [Wed Jun 29 07:55:44 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 07:55:44.590595 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi [None req-b0d7b1f7-73ee-44a6-ac62-ce4db61fffd4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "vcpus": 1, "disk": 1, "ram": 512, "id": "1", "swap": 0, "name": "m1.tiny", "rxtx_factor": 1.0}} {{(pid=103150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 07:55:44.621322 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: INFO nova.api.openstack.requestlog [None req-b0d7b1f7-73ee-44a6-ac62-ce4db61fffd4 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.116419 Jun 29 07:55:44.625588 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: [pid: 103150|app: 0|req: 12/22] 10.222.0.43 () {64 vars in 1282 bytes} [Wed Jun 29 07:55:44 2022] POST /compute/v2.1/flavors => generated 402 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 29 07:55:44.644192 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi [None req-42cf9a3f-d349-4f88-af17-fcfdda9cec34 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 07:55:44.693726 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: INFO nova.api.openstack.requestlog [None req-42cf9a3f-d349-4f88-af17-fcfdda9cec34 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.056356 Jun 29 07:55:44.695529 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: [pid: 103151|app: 0|req: 11/23] 10.222.0.43 () {64 vars in 1332 bytes} [Wed Jun 29 07:55:44 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 07:55:47.307027 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi [None req-b0d7b1f7-73ee-44a6-ac62-ce4db61fffd4 admin admin] Calling method '>' {{(pid=103150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 07:55:47.309064 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: INFO nova.api.openstack.requestlog [None req-b0d7b1f7-73ee-44a6-ac62-ce4db61fffd4 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003280 Jun 29 07:55:47.309959 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: [pid: 103150|app: 0|req: 13/24] 10.222.0.43 () {54 vars in 930 bytes} [Wed Jun 29 07:55:47 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 07:55:47.381672 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi [None req-4883ec7b-d9c7-459d-8b3b-ce4c16c4fb79 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "ram": 2048, "vcpus": 1, "disk": 20, "id": "2", "rxtx_factor": 1.0, "name": "m1.small", "swap": 0}} {{(pid=103151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 07:55:47.413444 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: INFO nova.api.openstack.requestlog [None req-4883ec7b-d9c7-459d-8b3b-ce4c16c4fb79 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.092978 Jun 29 07:55:47.415383 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: [pid: 103151|app: 0|req: 12/25] 10.222.0.43 () {64 vars in 1282 bytes} [Wed Jun 29 07:55:47 2022] POST /compute/v2.1/flavors => generated 405 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 29 07:55:47.427635 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi [None req-859faf07-ee33-4175-a168-37ece3fc4b47 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 07:55:47.453895 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: INFO nova.api.openstack.requestlog [None req-859faf07-ee33-4175-a168-37ece3fc4b47 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030010 Jun 29 07:55:47.454868 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: [pid: 103150|app: 0|req: 14/26] 10.222.0.43 () {64 vars in 1332 bytes} [Wed Jun 29 07:55:47 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 07:55:49.809575 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi [None req-4883ec7b-d9c7-459d-8b3b-ce4c16c4fb79 admin admin] Calling method '>' {{(pid=103151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 07:55:49.810593 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: INFO nova.api.openstack.requestlog [None req-4883ec7b-d9c7-459d-8b3b-ce4c16c4fb79 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001510 Jun 29 07:55:49.811015 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: [pid: 103151|app: 0|req: 13/27] 10.222.0.43 () {54 vars in 930 bytes} [Wed Jun 29 07:55:49 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 07:55:49.896186 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi [None req-777b776b-0017-4100-a79e-7010fec8d8e3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.medium", "os-flavor-access:is_public": true, "disk": 40, "rxtx_factor": 1.0, "vcpus": 2, "id": "3", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 4096, "swap": 0}} {{(pid=103150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 07:55:49.917161 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: INFO nova.api.openstack.requestlog [None req-777b776b-0017-4100-a79e-7010fec8d8e3 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.098252 Jun 29 07:55:49.918137 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: [pid: 103150|app: 0|req: 15/28] 10.222.0.43 () {64 vars in 1282 bytes} [Wed Jun 29 07:55:49 2022] POST /compute/v2.1/flavors => generated 406 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 29 07:55:49.934286 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi [None req-a4ff3570-df36-47be-aa21-2c6f79f29dd4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 07:55:49.970352 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: INFO nova.api.openstack.requestlog [None req-a4ff3570-df36-47be-aa21-2c6f79f29dd4 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.043680 Jun 29 07:55:49.970970 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: [pid: 103151|app: 0|req: 14/29] 10.222.0.43 () {64 vars in 1332 bytes} [Wed Jun 29 07:55:49 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 07:55:52.143420 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi [None req-777b776b-0017-4100-a79e-7010fec8d8e3 admin admin] Calling method '>' {{(pid=103150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 07:55:52.144502 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: INFO nova.api.openstack.requestlog [None req-777b776b-0017-4100-a79e-7010fec8d8e3 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001521 Jun 29 07:55:52.144912 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: [pid: 103150|app: 0|req: 16/30] 10.222.0.43 () {54 vars in 930 bytes} [Wed Jun 29 07:55:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 07:55:52.216498 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi [None req-964553fa-a5d1-4048-b73b-69925a8a0321 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "name": "m1.large", "disk": 80, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 4, "ram": 8192, "id": "4"}} {{(pid=103151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 07:55:52.237189 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: INFO nova.api.openstack.requestlog [None req-964553fa-a5d1-4048-b73b-69925a8a0321 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.085543 Jun 29 07:55:52.237755 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: [pid: 103151|app: 0|req: 15/31] 10.222.0.43 () {64 vars in 1282 bytes} [Wed Jun 29 07:55:52 2022] POST /compute/v2.1/flavors => generated 405 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 29 07:55:52.251165 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi [None req-ca583225-c773-482d-99e7-7c751905f882 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 07:55:52.279365 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: INFO nova.api.openstack.requestlog [None req-ca583225-c773-482d-99e7-7c751905f882 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032050 Jun 29 07:55:52.280188 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: [pid: 103150|app: 0|req: 17/32] 10.222.0.43 () {64 vars in 1332 bytes} [Wed Jun 29 07:55:52 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 07:55:54.530930 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi [None req-964553fa-a5d1-4048-b73b-69925a8a0321 admin admin] Calling method '>' {{(pid=103151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 07:55:54.531956 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: INFO nova.api.openstack.requestlog [None req-964553fa-a5d1-4048-b73b-69925a8a0321 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001469 Jun 29 07:55:54.532363 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: [pid: 103151|app: 0|req: 16/33] 10.222.0.43 () {54 vars in 930 bytes} [Wed Jun 29 07:55:54 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 29 07:55:54.603911 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi [None req-842c867e-355b-45e2-bac0-fa9d1721671b admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.xlarge", "disk": 160, "id": "5", "vcpus": 8, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "swap": 0, "rxtx_factor": 1.0, "ram": 16384}} {{(pid=103150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 07:55:54.624708 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: INFO nova.api.openstack.requestlog [None req-842c867e-355b-45e2-bac0-fa9d1721671b admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.085508 Jun 29 07:55:54.625373 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: [pid: 103150|app: 0|req: 18/34] 10.222.0.43 () {64 vars in 1282 bytes} [Wed Jun 29 07:55:54 2022] POST /compute/v2.1/flavors => generated 408 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 29 07:55:54.638575 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi [None req-15d862cb-95d1-4e23-ab07-e47243caf0e7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 07:55:54.664003 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: INFO nova.api.openstack.requestlog [None req-15d862cb-95d1-4e23-ab07-e47243caf0e7 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030267 Jun 29 07:55:54.664610 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: [pid: 103151|app: 0|req: 17/35] 10.222.0.43 () {64 vars in 1332 bytes} [Wed Jun 29 07:55:54 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 07:56:20.166544 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi [None req-842c867e-355b-45e2-bac0-fa9d1721671b admin admin] Calling method '>' {{(pid=103150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 07:56:20.167607 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: INFO nova.api.openstack.requestlog [None req-842c867e-355b-45e2-bac0-fa9d1721671b admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001469 Jun 29 07:56:20.167957 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: [pid: 103150|app: 0|req: 19/36] 10.222.0.43 () {54 vars in 930 bytes} [Wed Jun 29 07:56:20 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 07:56:20.176736 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG dbcounter [-] [103151] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=10,nova_api:SAVEPOINT=5,nova_api:RELEASE=5 {{(pid=103151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 07:56:20.233913 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi [None req-0afb598b-c58e-4f7d-b719-3f659c58ec3e admin admin] Calling method '>' {{(pid=103151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 07:56:20.251040 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: INFO nova.api.openstack.requestlog [None req-0afb598b-c58e-4f7d-b719-3f659c58ec3e admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.075230 Jun 29 07:56:20.251592 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: [pid: 103151|app: 0|req: 18/37] 10.222.0.43 () {60 vars in 1291 bytes} [Wed Jun 29 07:56:20 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 07:56:21.238226 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi [None req-842c867e-355b-45e2-bac0-fa9d1721671b admin admin] Calling method '>' {{(pid=103150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 07:56:21.239234 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: INFO nova.api.openstack.requestlog [None req-842c867e-355b-45e2-bac0-fa9d1721671b admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001433 Jun 29 07:56:21.239642 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: [pid: 103150|app: 0|req: 20/38] 10.222.0.43 () {56 vars in 1074 bytes} [Wed Jun 29 07:56:21 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 07:56:21.448814 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi [None req-2870a7c6-9483-4a86-adab-42af3d4ae833 admin admin] Calling method '>' {{(pid=103151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 07:56:21.454790 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: INFO nova.api.openstack.wsgi [None req-2870a7c6-9483-4a86-adab-42af3d4ae833 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 29 07:56:21.457984 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi [None req-2870a7c6-9483-4a86-adab-42af3d4ae833 admin admin] Request method failure captured: Jun 29 07:56:21.457984 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 29 07:56:21.457984 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: Accept: application/json Jun 29 07:56:21.457984 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: Accept-Encoding: gzip, deflate Jun 29 07:56:21.457984 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: Connection: keep-alive Jun 29 07:56:21.457984 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: Content-Length: 0 Jun 29 07:56:21.457984 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: Host: 10.222.0.43 Jun 29 07:56:21.457984 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: Openstack-Api-Version: compute 2.90 Jun 29 07:56:21.457984 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: Openstack-System-Scope: None Jun 29 07:56:21.457984 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: User-Agent: python-novaclient Jun 29 07:56:21.457984 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: X-Auth-Token: gAAAAABivAWlDlfIwnrRRxId8z5HTuG4XBK4FOIpSe-kEW_gJS4fILqb937hU_gZgkWbUQFtrUbNcNa_Jlyv3Okz4s6eEEDi9jXQU9g3BYiHjtjZ2oHyF7fytng1tKE9UsQx4GVlm2N_KLpmVuJ6o2ef_uiMMLT1gCOe_18hJP7cNpvjp1_g_dM Jun 29 07:56:21.457984 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: X-Domain-Id: None Jun 29 07:56:21.457984 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: X-Domain-Name: None Jun 29 07:56:21.457984 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: X-Identity-Status: Confirmed Jun 29 07:56:21.457984 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: X-Is-Admin-Project: True Jun 29 07:56:21.457984 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: X-Openstack-Nova-Api-Version: 2.90 Jun 29 07:56:21.457984 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: X-Project-Domain-Id: default Jun 29 07:56:21.457984 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: X-Project-Domain-Name: Default Jun 29 07:56:21.457984 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: X-Project-Id: c4e7f90bb9da44679fd899e1c8b90999 Jun 29 07:56:21.457984 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: X-Project-Name: admin Jun 29 07:56:21.457984 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: X-Role: member,reader,admin Jun 29 07:56:21.457984 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: X-Roles: member,reader,admin Jun 29 07:56:21.459761 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/c4e7f90bb9da44679fd899e1c8b90999"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_c4e7f90bb9da44679fd899e1c8b90999"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/c4e7f90bb9da44679fd899e1c8b90999"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/c4e7f90bb9da44679fd899e1c8b90999"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Jun 29 07:56:21.459761 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: X-Tenant: admin Jun 29 07:56:21.459761 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: X-Tenant-Id: c4e7f90bb9da44679fd899e1c8b90999 Jun 29 07:56:21.459761 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: X-Tenant-Name: admin Jun 29 07:56:21.459761 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: X-User: admin Jun 29 07:56:21.459761 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: X-User-Domain-Id: default Jun 29 07:56:21.459761 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: X-User-Domain-Name: Default Jun 29 07:56:21.459761 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: X-User-Id: b406de2279df4cff9aec118a80931d53 Jun 29 07:56:21.459761 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: X-User-Name: admin Jun 29 07:56:21.459761 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: method: > Jun 29 07:56:21.459761 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: exception: Flavor 42 could not be found. Jun 29 07:56:21.459761 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: action_args: {'id': '42'} Jun 29 07:56:21.459761 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: {{(pid=103151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 07:56:21.459761 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 07:56:21.460936 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 29 07:56:21.460936 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 29 07:56:21.460936 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 29 07:56:21.460936 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 29 07:56:21.460936 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 29 07:56:21.460936 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 29 07:56:21.460936 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 29 07:56:21.460936 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 29 07:56:21.460936 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 29 07:56:21.460936 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 07:56:21.460936 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 29 07:56:21.460936 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 29 07:56:21.460936 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 29 07:56:21.460936 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi Jun 29 07:56:21.460936 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 07:56:21.460936 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi Jun 29 07:56:21.460936 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 07:56:21.460936 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 07:56:21.460936 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 07:56:21.463611 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 07:56:21.463611 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 07:56:21.463611 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 07:56:21.463611 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 07:56:21.463611 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 29 07:56:21.463611 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 29 07:56:21.463611 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 29 07:56:21.463611 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi Jun 29 07:56:21.463611 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 07:56:21.463611 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi Jun 29 07:56:21.463611 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 07:56:21.463611 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 07:56:21.463611 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 07:56:21.463611 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 07:56:21.463611 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 07:56:21.463611 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 29 07:56:21.463611 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi Jun 29 07:56:21.463611 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi [None req-2870a7c6-9483-4a86-adab-42af3d4ae833 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103151) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 07:56:21.465011 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: INFO nova.api.openstack.requestlog [None req-2870a7c6-9483-4a86-adab-42af3d4ae833 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.065449 Jun 29 07:56:21.465011 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: [pid: 103151|app: 0|req: 19/39] 10.222.0.43 () {60 vars in 1190 bytes} [Wed Jun 29 07:56:21 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 29 07:56:21.471155 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi [None req-ef4ac303-d1cd-4d34-a349-dbfe2842ba59 admin admin] Calling method '>' {{(pid=103150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 07:56:21.474106 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG dbcounter [-] [103150] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 07:56:21.495290 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: INFO nova.api.openstack.requestlog [None req-ef4ac303-d1cd-4d34-a349-dbfe2842ba59 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027803 Jun 29 07:56:21.495878 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: [pid: 103150|app: 0|req: 21/40] 10.222.0.43 () {60 vars in 1210 bytes} [Wed Jun 29 07:56:21 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 07:56:21.505598 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi [None req-5bd912a3-3e8d-483a-b57f-2f84bcb85bbb admin admin] Calling method '>' {{(pid=103151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 07:56:21.528260 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: INFO nova.api.openstack.requestlog [None req-5bd912a3-3e8d-483a-b57f-2f84bcb85bbb admin admin] 10.222.0.43 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026155 Jun 29 07:56:21.528826 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: [pid: 103151|app: 0|req: 20/41] 10.222.0.43 () {60 vars in 1210 bytes} [Wed Jun 29 07:56:21 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 07:56:21.540735 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi [None req-e90ee766-d6f2-499f-9ac3-4ca60fc74f89 admin admin] Calling method '>' {{(pid=103150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 07:56:21.546740 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: INFO nova.api.openstack.wsgi [None req-e90ee766-d6f2-499f-9ac3-4ca60fc74f89 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 29 07:56:21.550320 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi [None req-e90ee766-d6f2-499f-9ac3-4ca60fc74f89 admin admin] Request method failure captured: Jun 29 07:56:21.550320 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 29 07:56:21.550320 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: Accept: application/json Jun 29 07:56:21.550320 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: Accept-Encoding: gzip, deflate Jun 29 07:56:21.550320 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: Connection: keep-alive Jun 29 07:56:21.550320 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: Content-Length: 0 Jun 29 07:56:21.550320 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: Host: 10.222.0.43 Jun 29 07:56:21.550320 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: Openstack-Api-Version: compute 2.90 Jun 29 07:56:21.550320 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: Openstack-System-Scope: None Jun 29 07:56:21.550320 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: User-Agent: python-novaclient Jun 29 07:56:21.550320 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: X-Auth-Token: gAAAAABivAWlDlfIwnrRRxId8z5HTuG4XBK4FOIpSe-kEW_gJS4fILqb937hU_gZgkWbUQFtrUbNcNa_Jlyv3Okz4s6eEEDi9jXQU9g3BYiHjtjZ2oHyF7fytng1tKE9UsQx4GVlm2N_KLpmVuJ6o2ef_uiMMLT1gCOe_18hJP7cNpvjp1_g_dM Jun 29 07:56:21.550320 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: X-Domain-Id: None Jun 29 07:56:21.550320 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: X-Domain-Name: None Jun 29 07:56:21.550320 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: X-Identity-Status: Confirmed Jun 29 07:56:21.550320 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: X-Is-Admin-Project: True Jun 29 07:56:21.550320 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: X-Openstack-Nova-Api-Version: 2.90 Jun 29 07:56:21.550320 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: X-Project-Domain-Id: default Jun 29 07:56:21.550320 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: X-Project-Domain-Name: Default Jun 29 07:56:21.550320 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: X-Project-Id: c4e7f90bb9da44679fd899e1c8b90999 Jun 29 07:56:21.550320 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: X-Project-Name: admin Jun 29 07:56:21.550320 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: X-Role: member,reader,admin Jun 29 07:56:21.550320 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: X-Roles: member,reader,admin Jun 29 07:56:21.551870 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/c4e7f90bb9da44679fd899e1c8b90999"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_c4e7f90bb9da44679fd899e1c8b90999"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/c4e7f90bb9da44679fd899e1c8b90999"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/c4e7f90bb9da44679fd899e1c8b90999"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Jun 29 07:56:21.551870 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: X-Tenant: admin Jun 29 07:56:21.551870 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: X-Tenant-Id: c4e7f90bb9da44679fd899e1c8b90999 Jun 29 07:56:21.551870 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: X-Tenant-Name: admin Jun 29 07:56:21.551870 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: X-User: admin Jun 29 07:56:21.551870 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: X-User-Domain-Id: default Jun 29 07:56:21.551870 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: X-User-Domain-Name: Default Jun 29 07:56:21.551870 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: X-User-Id: b406de2279df4cff9aec118a80931d53 Jun 29 07:56:21.551870 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: X-User-Name: admin Jun 29 07:56:21.551870 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: method: > Jun 29 07:56:21.551870 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: exception: Flavor 42 could not be found. Jun 29 07:56:21.551870 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: action_args: {'id': '42'} Jun 29 07:56:21.551870 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: {{(pid=103150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 07:56:21.551870 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 07:56:21.552874 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 29 07:56:21.552874 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 29 07:56:21.552874 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 29 07:56:21.552874 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 29 07:56:21.552874 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 29 07:56:21.552874 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 29 07:56:21.552874 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 29 07:56:21.552874 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 29 07:56:21.552874 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 29 07:56:21.552874 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 07:56:21.552874 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 29 07:56:21.552874 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 29 07:56:21.552874 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 29 07:56:21.552874 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: ERROR nova.api.openstack.wsgi Jun 29 07:56:21.552874 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 07:56:21.552874 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: ERROR nova.api.openstack.wsgi Jun 29 07:56:21.552874 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 07:56:21.552874 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 07:56:21.552874 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 07:56:21.554180 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 07:56:21.554180 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 07:56:21.554180 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 07:56:21.554180 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 07:56:21.554180 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 29 07:56:21.554180 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 29 07:56:21.554180 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 29 07:56:21.554180 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: ERROR nova.api.openstack.wsgi Jun 29 07:56:21.554180 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 07:56:21.554180 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: ERROR nova.api.openstack.wsgi Jun 29 07:56:21.554180 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 07:56:21.554180 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 07:56:21.554180 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 07:56:21.554180 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 07:56:21.554180 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 07:56:21.554180 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 29 07:56:21.554180 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: ERROR nova.api.openstack.wsgi Jun 29 07:56:21.554180 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi [None req-e90ee766-d6f2-499f-9ac3-4ca60fc74f89 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103150) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 07:56:21.555372 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: INFO nova.api.openstack.requestlog [None req-e90ee766-d6f2-499f-9ac3-4ca60fc74f89 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.015398 Jun 29 07:56:21.555372 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: [pid: 103150|app: 0|req: 22/42] 10.222.0.43 () {60 vars in 1190 bytes} [Wed Jun 29 07:56:21 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 29 07:56:22.386632 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi [None req-5bd912a3-3e8d-483a-b57f-2f84bcb85bbb admin admin] Calling method '>' {{(pid=103151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 07:56:22.387638 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: INFO nova.api.openstack.requestlog [None req-5bd912a3-3e8d-483a-b57f-2f84bcb85bbb admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001445 Jun 29 07:56:22.388036 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: [pid: 103151|app: 0|req: 21/43] 10.222.0.43 () {56 vars in 1074 bytes} [Wed Jun 29 07:56:22 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 07:56:22.583262 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi [None req-d5a2df79-b761-474c-bb41-f10e2dccd4c6 admin admin] Calling method '>' {{(pid=103150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 07:56:22.589309 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: INFO nova.api.openstack.wsgi [None req-d5a2df79-b761-474c-bb41-f10e2dccd4c6 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 29 07:56:22.590845 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi [None req-d5a2df79-b761-474c-bb41-f10e2dccd4c6 admin admin] Request method failure captured: Jun 29 07:56:22.590845 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 29 07:56:22.590845 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: Accept: application/json Jun 29 07:56:22.590845 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: Accept-Encoding: gzip, deflate Jun 29 07:56:22.590845 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: Connection: keep-alive Jun 29 07:56:22.590845 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: Content-Length: 0 Jun 29 07:56:22.590845 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: Host: 10.222.0.43 Jun 29 07:56:22.590845 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: Openstack-Api-Version: compute 2.90 Jun 29 07:56:22.590845 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: Openstack-System-Scope: None Jun 29 07:56:22.590845 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: User-Agent: python-novaclient Jun 29 07:56:22.590845 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: X-Auth-Token: gAAAAABivAWmCRIwJwqUSP7lNLXVRzz4_dnnwSNh-gXtKi7AtG7Pz-lsBAudbesC5g1RLiJQ_VS3l_pr9RmGL5NFchu2KMNFwTV0tx1dIk0a02jh0M47aYbJBIARMyZWGYqEFwOhTV6RRvddZAqCosf2NmSAgRoclAQWtoxKF56-yRCrGjdd0mM Jun 29 07:56:22.590845 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: X-Domain-Id: None Jun 29 07:56:22.590845 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: X-Domain-Name: None Jun 29 07:56:22.590845 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: X-Identity-Status: Confirmed Jun 29 07:56:22.590845 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: X-Is-Admin-Project: True Jun 29 07:56:22.590845 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: X-Openstack-Nova-Api-Version: 2.90 Jun 29 07:56:22.590845 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: X-Project-Domain-Id: default Jun 29 07:56:22.590845 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: X-Project-Domain-Name: Default Jun 29 07:56:22.590845 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: X-Project-Id: c4e7f90bb9da44679fd899e1c8b90999 Jun 29 07:56:22.590845 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: X-Project-Name: admin Jun 29 07:56:22.590845 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: X-Role: member,reader,admin Jun 29 07:56:22.590845 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: X-Roles: member,reader,admin Jun 29 07:56:22.592107 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/c4e7f90bb9da44679fd899e1c8b90999"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_c4e7f90bb9da44679fd899e1c8b90999"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/c4e7f90bb9da44679fd899e1c8b90999"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/c4e7f90bb9da44679fd899e1c8b90999"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Jun 29 07:56:22.592107 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: X-Tenant: admin Jun 29 07:56:22.592107 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: X-Tenant-Id: c4e7f90bb9da44679fd899e1c8b90999 Jun 29 07:56:22.592107 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: X-Tenant-Name: admin Jun 29 07:56:22.592107 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: X-User: admin Jun 29 07:56:22.592107 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: X-User-Domain-Id: default Jun 29 07:56:22.592107 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: X-User-Domain-Name: Default Jun 29 07:56:22.592107 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: X-User-Id: b406de2279df4cff9aec118a80931d53 Jun 29 07:56:22.592107 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: X-User-Name: admin Jun 29 07:56:22.592107 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: method: > Jun 29 07:56:22.592107 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: exception: Flavor 84 could not be found. Jun 29 07:56:22.592107 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: action_args: {'id': '84'} Jun 29 07:56:22.592107 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: {{(pid=103150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 07:56:22.592107 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 07:56:22.592913 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 29 07:56:22.592913 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 29 07:56:22.592913 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 29 07:56:22.592913 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 29 07:56:22.592913 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 29 07:56:22.592913 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 29 07:56:22.592913 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 29 07:56:22.592913 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 29 07:56:22.592913 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 29 07:56:22.592913 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 07:56:22.592913 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 29 07:56:22.592913 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 29 07:56:22.592913 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 29 07:56:22.592913 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: ERROR nova.api.openstack.wsgi Jun 29 07:56:22.592913 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 07:56:22.592913 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: ERROR nova.api.openstack.wsgi Jun 29 07:56:22.592913 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 07:56:22.592913 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 07:56:22.592913 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 07:56:22.594198 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 07:56:22.594198 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 07:56:22.594198 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 07:56:22.594198 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 07:56:22.594198 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 29 07:56:22.594198 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 29 07:56:22.594198 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 29 07:56:22.594198 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: ERROR nova.api.openstack.wsgi Jun 29 07:56:22.594198 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 07:56:22.594198 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: ERROR nova.api.openstack.wsgi Jun 29 07:56:22.594198 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 07:56:22.594198 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 07:56:22.594198 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 07:56:22.594198 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 07:56:22.594198 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 07:56:22.594198 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 29 07:56:22.594198 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: ERROR nova.api.openstack.wsgi Jun 29 07:56:22.594198 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi [None req-d5a2df79-b761-474c-bb41-f10e2dccd4c6 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103150) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 07:56:22.595419 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: INFO nova.api.openstack.requestlog [None req-d5a2df79-b761-474c-bb41-f10e2dccd4c6 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.064692 Jun 29 07:56:22.595419 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: [pid: 103150|app: 0|req: 23/44] 10.222.0.43 () {60 vars in 1190 bytes} [Wed Jun 29 07:56:22 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 29 07:56:22.603093 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi [None req-d1d3c17a-11ff-494f-b008-24880b9ceb86 admin admin] Calling method '>' {{(pid=103151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 07:56:22.617190 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: INFO nova.api.openstack.requestlog [None req-d1d3c17a-11ff-494f-b008-24880b9ceb86 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018619 Jun 29 07:56:22.618416 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: [pid: 103151|app: 0|req: 22/45] 10.222.0.43 () {60 vars in 1210 bytes} [Wed Jun 29 07:56:22 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 07:56:22.628702 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi [None req-e496c624-c248-44a9-94c2-11ca2df27126 admin admin] Calling method '>' {{(pid=103150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 07:56:22.643939 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: INFO nova.api.openstack.requestlog [None req-e496c624-c248-44a9-94c2-11ca2df27126 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019002 Jun 29 07:56:22.644511 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: [pid: 103150|app: 0|req: 24/46] 10.222.0.43 () {60 vars in 1210 bytes} [Wed Jun 29 07:56:22 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 29 07:56:22.658564 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi [None req-79a6a7a6-bdfc-44e7-8143-671807695f6d admin admin] Calling method '>' {{(pid=103151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 07:56:22.668526 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: INFO nova.api.openstack.wsgi [None req-79a6a7a6-bdfc-44e7-8143-671807695f6d admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 29 07:56:22.671801 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi [None req-79a6a7a6-bdfc-44e7-8143-671807695f6d admin admin] Request method failure captured: Jun 29 07:56:22.671801 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 29 07:56:22.671801 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: Accept: application/json Jun 29 07:56:22.671801 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: Accept-Encoding: gzip, deflate Jun 29 07:56:22.671801 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: Connection: keep-alive Jun 29 07:56:22.671801 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: Content-Length: 0 Jun 29 07:56:22.671801 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: Host: 10.222.0.43 Jun 29 07:56:22.671801 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: Openstack-Api-Version: compute 2.90 Jun 29 07:56:22.671801 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: Openstack-System-Scope: None Jun 29 07:56:22.671801 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: User-Agent: python-novaclient Jun 29 07:56:22.671801 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: X-Auth-Token: gAAAAABivAWmCRIwJwqUSP7lNLXVRzz4_dnnwSNh-gXtKi7AtG7Pz-lsBAudbesC5g1RLiJQ_VS3l_pr9RmGL5NFchu2KMNFwTV0tx1dIk0a02jh0M47aYbJBIARMyZWGYqEFwOhTV6RRvddZAqCosf2NmSAgRoclAQWtoxKF56-yRCrGjdd0mM Jun 29 07:56:22.671801 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: X-Domain-Id: None Jun 29 07:56:22.671801 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: X-Domain-Name: None Jun 29 07:56:22.671801 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: X-Identity-Status: Confirmed Jun 29 07:56:22.671801 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: X-Is-Admin-Project: True Jun 29 07:56:22.671801 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: X-Openstack-Nova-Api-Version: 2.90 Jun 29 07:56:22.671801 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: X-Project-Domain-Id: default Jun 29 07:56:22.671801 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: X-Project-Domain-Name: Default Jun 29 07:56:22.671801 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: X-Project-Id: c4e7f90bb9da44679fd899e1c8b90999 Jun 29 07:56:22.671801 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: X-Project-Name: admin Jun 29 07:56:22.671801 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: X-Role: member,reader,admin Jun 29 07:56:22.671801 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: X-Roles: member,reader,admin Jun 29 07:56:22.673610 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/c4e7f90bb9da44679fd899e1c8b90999"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_c4e7f90bb9da44679fd899e1c8b90999"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/c4e7f90bb9da44679fd899e1c8b90999"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/c4e7f90bb9da44679fd899e1c8b90999"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Jun 29 07:56:22.673610 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: X-Tenant: admin Jun 29 07:56:22.673610 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: X-Tenant-Id: c4e7f90bb9da44679fd899e1c8b90999 Jun 29 07:56:22.673610 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: X-Tenant-Name: admin Jun 29 07:56:22.673610 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: X-User: admin Jun 29 07:56:22.673610 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: X-User-Domain-Id: default Jun 29 07:56:22.673610 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: X-User-Domain-Name: Default Jun 29 07:56:22.673610 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: X-User-Id: b406de2279df4cff9aec118a80931d53 Jun 29 07:56:22.673610 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: X-User-Name: admin Jun 29 07:56:22.673610 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: method: > Jun 29 07:56:22.673610 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: exception: Flavor 84 could not be found. Jun 29 07:56:22.673610 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: action_args: {'id': '84'} Jun 29 07:56:22.673610 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: {{(pid=103151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 07:56:22.673610 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 07:56:22.674564 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 29 07:56:22.674564 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 29 07:56:22.674564 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 29 07:56:22.674564 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 29 07:56:22.674564 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 29 07:56:22.674564 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 29 07:56:22.674564 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 29 07:56:22.674564 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 29 07:56:22.674564 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 29 07:56:22.674564 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 07:56:22.674564 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 29 07:56:22.674564 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 29 07:56:22.674564 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 29 07:56:22.674564 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi Jun 29 07:56:22.674564 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 07:56:22.674564 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi Jun 29 07:56:22.674564 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 07:56:22.674564 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 07:56:22.674564 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 07:56:22.675901 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 07:56:22.675901 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 07:56:22.675901 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 07:56:22.675901 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 07:56:22.675901 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 29 07:56:22.675901 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 29 07:56:22.675901 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 29 07:56:22.675901 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi Jun 29 07:56:22.675901 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 07:56:22.675901 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi Jun 29 07:56:22.675901 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 07:56:22.675901 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 07:56:22.675901 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 07:56:22.675901 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 07:56:22.675901 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 07:56:22.675901 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 29 07:56:22.675901 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi Jun 29 07:56:22.675901 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi [None req-79a6a7a6-bdfc-44e7-8143-671807695f6d admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103151) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 07:56:22.677071 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: INFO nova.api.openstack.requestlog [None req-79a6a7a6-bdfc-44e7-8143-671807695f6d admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.023099 Jun 29 07:56:22.677071 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: [pid: 103151|app: 0|req: 23/47] 10.222.0.43 () {60 vars in 1190 bytes} [Wed Jun 29 07:56:22 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 25 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 29 07:56:23.592216 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi [None req-e496c624-c248-44a9-94c2-11ca2df27126 admin admin] Calling method '>' {{(pid=103150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 07:56:23.593247 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: INFO nova.api.openstack.requestlog [None req-e496c624-c248-44a9-94c2-11ca2df27126 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001453 Jun 29 07:56:23.593655 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: [pid: 103150|app: 0|req: 25/48] 10.222.0.43 () {56 vars in 1074 bytes} [Wed Jun 29 07:56:23 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 07:56:23.790531 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi [None req-29b8e6cd-7093-4d2f-b14f-a61795126f40 admin admin] Calling method '>' {{(pid=103151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 07:56:23.797987 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: INFO nova.api.openstack.wsgi [None req-29b8e6cd-7093-4d2f-b14f-a61795126f40 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 29 07:56:23.799769 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi [None req-29b8e6cd-7093-4d2f-b14f-a61795126f40 admin admin] Request method failure captured: Jun 29 07:56:23.799769 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 29 07:56:23.799769 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: Accept: application/json Jun 29 07:56:23.799769 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: Accept-Encoding: gzip, deflate Jun 29 07:56:23.799769 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: Connection: keep-alive Jun 29 07:56:23.799769 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: Content-Length: 0 Jun 29 07:56:23.799769 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: Host: 10.222.0.43 Jun 29 07:56:23.799769 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: Openstack-Api-Version: compute 2.90 Jun 29 07:56:23.799769 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: Openstack-System-Scope: None Jun 29 07:56:23.799769 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: User-Agent: python-novaclient Jun 29 07:56:23.799769 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: X-Auth-Token: gAAAAABivAWn9h227GORusu6JRrAbEI7G086GAPDQ7e9MEVUK0CAw5ylxAmQqDNFPyNPkI3yy_C_KH7GQNxb85ZcJz1j_7C_PNohzIMpo4TtuEUVhioiiQfvd3iEuuvFVlhaC27W2BwXyJ515na4-MNOvjyadnLcXJdU1vCBngkFaY_zJabohqU Jun 29 07:56:23.799769 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: X-Domain-Id: None Jun 29 07:56:23.799769 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: X-Domain-Name: None Jun 29 07:56:23.799769 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: X-Identity-Status: Confirmed Jun 29 07:56:23.799769 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: X-Is-Admin-Project: True Jun 29 07:56:23.799769 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: X-Openstack-Nova-Api-Version: 2.90 Jun 29 07:56:23.799769 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: X-Project-Domain-Id: default Jun 29 07:56:23.799769 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: X-Project-Domain-Name: Default Jun 29 07:56:23.799769 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: X-Project-Id: c4e7f90bb9da44679fd899e1c8b90999 Jun 29 07:56:23.799769 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: X-Project-Name: admin Jun 29 07:56:23.799769 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: X-Role: member,reader,admin Jun 29 07:56:23.799769 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: X-Roles: member,reader,admin Jun 29 07:56:23.801195 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/c4e7f90bb9da44679fd899e1c8b90999"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_c4e7f90bb9da44679fd899e1c8b90999"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/c4e7f90bb9da44679fd899e1c8b90999"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/c4e7f90bb9da44679fd899e1c8b90999"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Jun 29 07:56:23.801195 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: X-Tenant: admin Jun 29 07:56:23.801195 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: X-Tenant-Id: c4e7f90bb9da44679fd899e1c8b90999 Jun 29 07:56:23.801195 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: X-Tenant-Name: admin Jun 29 07:56:23.801195 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: X-User: admin Jun 29 07:56:23.801195 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: X-User-Domain-Id: default Jun 29 07:56:23.801195 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: X-User-Domain-Name: Default Jun 29 07:56:23.801195 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: X-User-Id: b406de2279df4cff9aec118a80931d53 Jun 29 07:56:23.801195 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: X-User-Name: admin Jun 29 07:56:23.801195 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: method: > Jun 29 07:56:23.801195 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: exception: Flavor 451 could not be found. Jun 29 07:56:23.801195 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: action_args: {'id': '451'} Jun 29 07:56:23.801195 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: {{(pid=103151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 07:56:23.801195 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 07:56:23.801983 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 29 07:56:23.801983 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 29 07:56:23.801983 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 29 07:56:23.801983 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 29 07:56:23.801983 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 29 07:56:23.801983 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 29 07:56:23.801983 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 29 07:56:23.801983 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 29 07:56:23.801983 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 29 07:56:23.801983 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 07:56:23.801983 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 29 07:56:23.801983 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 29 07:56:23.801983 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 29 07:56:23.801983 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi Jun 29 07:56:23.801983 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 07:56:23.801983 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi Jun 29 07:56:23.801983 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 07:56:23.801983 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 07:56:23.801983 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 07:56:23.803034 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 07:56:23.803034 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 07:56:23.803034 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 07:56:23.803034 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 07:56:23.803034 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 29 07:56:23.803034 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 29 07:56:23.803034 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 29 07:56:23.803034 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi Jun 29 07:56:23.803034 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 07:56:23.803034 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi Jun 29 07:56:23.803034 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 07:56:23.803034 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 07:56:23.803034 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 07:56:23.803034 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 07:56:23.803034 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 07:56:23.803034 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 29 07:56:23.803034 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: ERROR nova.api.openstack.wsgi Jun 29 07:56:23.803034 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi [None req-29b8e6cd-7093-4d2f-b14f-a61795126f40 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103151) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 07:56:23.804055 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: INFO nova.api.openstack.requestlog [None req-29b8e6cd-7093-4d2f-b14f-a61795126f40 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.067227 Jun 29 07:56:23.804055 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: [pid: 103151|app: 0|req: 24/49] 10.222.0.43 () {60 vars in 1193 bytes} [Wed Jun 29 07:56:23 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 29 07:56:23.813426 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi [None req-8a50409e-01af-4c49-98cc-222e2280c4a4 admin admin] Calling method '>' {{(pid=103150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 07:56:23.829678 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: INFO nova.api.openstack.requestlog [None req-8a50409e-01af-4c49-98cc-222e2280c4a4 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019725 Jun 29 07:56:23.830254 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: [pid: 103150|app: 0|req: 26/50] 10.222.0.43 () {60 vars in 1210 bytes} [Wed Jun 29 07:56:23 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 07:56:23.842732 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi [None req-9e8510ea-7f7c-4f5a-aeb6-569deba9f70a admin admin] Calling method '>' {{(pid=103151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 07:56:23.858225 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: INFO nova.api.openstack.requestlog [None req-9e8510ea-7f7c-4f5a-aeb6-569deba9f70a admin admin] 10.222.0.43 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.020558 Jun 29 07:56:23.858801 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: [pid: 103151|app: 0|req: 25/51] 10.222.0.43 () {60 vars in 1210 bytes} [Wed Jun 29 07:56:23 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 29 07:56:23.868639 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi [None req-2e37d489-44e5-410d-a9dc-cb94407f3e49 admin admin] Calling method '>' {{(pid=103150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 07:56:23.874290 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: INFO nova.api.openstack.wsgi [None req-2e37d489-44e5-410d-a9dc-cb94407f3e49 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 29 07:56:23.875813 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi [None req-2e37d489-44e5-410d-a9dc-cb94407f3e49 admin admin] Request method failure captured: Jun 29 07:56:23.875813 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 29 07:56:23.875813 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: Accept: application/json Jun 29 07:56:23.875813 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: Accept-Encoding: gzip, deflate Jun 29 07:56:23.875813 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: Connection: keep-alive Jun 29 07:56:23.875813 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: Content-Length: 0 Jun 29 07:56:23.875813 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: Host: 10.222.0.43 Jun 29 07:56:23.875813 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: Openstack-Api-Version: compute 2.90 Jun 29 07:56:23.875813 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: Openstack-System-Scope: None Jun 29 07:56:23.875813 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: User-Agent: python-novaclient Jun 29 07:56:23.875813 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: X-Auth-Token: gAAAAABivAWn9h227GORusu6JRrAbEI7G086GAPDQ7e9MEVUK0CAw5ylxAmQqDNFPyNPkI3yy_C_KH7GQNxb85ZcJz1j_7C_PNohzIMpo4TtuEUVhioiiQfvd3iEuuvFVlhaC27W2BwXyJ515na4-MNOvjyadnLcXJdU1vCBngkFaY_zJabohqU Jun 29 07:56:23.875813 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: X-Domain-Id: None Jun 29 07:56:23.875813 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: X-Domain-Name: None Jun 29 07:56:23.875813 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: X-Identity-Status: Confirmed Jun 29 07:56:23.875813 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: X-Is-Admin-Project: True Jun 29 07:56:23.875813 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: X-Openstack-Nova-Api-Version: 2.90 Jun 29 07:56:23.875813 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: X-Project-Domain-Id: default Jun 29 07:56:23.875813 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: X-Project-Domain-Name: Default Jun 29 07:56:23.875813 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: X-Project-Id: c4e7f90bb9da44679fd899e1c8b90999 Jun 29 07:56:23.875813 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: X-Project-Name: admin Jun 29 07:56:23.875813 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: X-Role: member,reader,admin Jun 29 07:56:23.875813 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: X-Roles: member,reader,admin Jun 29 07:56:23.877472 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/c4e7f90bb9da44679fd899e1c8b90999"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_c4e7f90bb9da44679fd899e1c8b90999"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/c4e7f90bb9da44679fd899e1c8b90999"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/c4e7f90bb9da44679fd899e1c8b90999"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Jun 29 07:56:23.877472 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: X-Tenant: admin Jun 29 07:56:23.877472 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: X-Tenant-Id: c4e7f90bb9da44679fd899e1c8b90999 Jun 29 07:56:23.877472 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: X-Tenant-Name: admin Jun 29 07:56:23.877472 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: X-User: admin Jun 29 07:56:23.877472 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: X-User-Domain-Id: default Jun 29 07:56:23.877472 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: X-User-Domain-Name: Default Jun 29 07:56:23.877472 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: X-User-Id: b406de2279df4cff9aec118a80931d53 Jun 29 07:56:23.877472 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: X-User-Name: admin Jun 29 07:56:23.877472 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: method: > Jun 29 07:56:23.877472 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: exception: Flavor 451 could not be found. Jun 29 07:56:23.877472 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: action_args: {'id': '451'} Jun 29 07:56:23.877472 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: {{(pid=103150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 07:56:23.877472 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 07:56:23.878460 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 29 07:56:23.878460 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 29 07:56:23.878460 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 29 07:56:23.878460 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 29 07:56:23.878460 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 29 07:56:23.878460 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 29 07:56:23.878460 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 29 07:56:23.878460 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 29 07:56:23.878460 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 29 07:56:23.878460 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 07:56:23.878460 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 29 07:56:23.878460 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 29 07:56:23.878460 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 29 07:56:23.878460 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: ERROR nova.api.openstack.wsgi Jun 29 07:56:23.878460 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 07:56:23.878460 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: ERROR nova.api.openstack.wsgi Jun 29 07:56:23.878460 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 07:56:23.878460 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 07:56:23.878460 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 07:56:23.879783 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 07:56:23.879783 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 07:56:23.879783 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 07:56:23.879783 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 07:56:23.879783 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 29 07:56:23.879783 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 29 07:56:23.879783 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 29 07:56:23.879783 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: ERROR nova.api.openstack.wsgi Jun 29 07:56:23.879783 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 07:56:23.879783 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: ERROR nova.api.openstack.wsgi Jun 29 07:56:23.879783 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 07:56:23.879783 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 07:56:23.879783 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 07:56:23.879783 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 07:56:23.879783 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 07:56:23.879783 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 29 07:56:23.879783 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: ERROR nova.api.openstack.wsgi Jun 29 07:56:23.879783 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi [None req-2e37d489-44e5-410d-a9dc-cb94407f3e49 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103150) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 07:56:23.880787 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: INFO nova.api.openstack.requestlog [None req-2e37d489-44e5-410d-a9dc-cb94407f3e49 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012275 Jun 29 07:56:23.880787 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: [pid: 103150|app: 0|req: 27/52] 10.222.0.43 () {60 vars in 1193 bytes} [Wed Jun 29 07:56:23 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jun 29 07:56:24.714678 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi [None req-9e8510ea-7f7c-4f5a-aeb6-569deba9f70a admin admin] Calling method '>' {{(pid=103151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 07:56:24.715680 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: INFO nova.api.openstack.requestlog [None req-9e8510ea-7f7c-4f5a-aeb6-569deba9f70a admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001423 Jun 29 07:56:24.716071 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: [pid: 103151|app: 0|req: 26/53] 10.222.0.43 () {56 vars in 1074 bytes} [Wed Jun 29 07:56:24 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 07:56:24.910665 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi [None req-0bfb079a-1a34-44ac-8c04-a3dd82a24c9a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 07:56:24.928836 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: INFO nova.api.openstack.requestlog [None req-0bfb079a-1a34-44ac-8c04-a3dd82a24c9a admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.075566 Jun 29 07:56:24.929343 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: [pid: 103150|app: 0|req: 28/54] 10.222.0.43 () {64 vars in 1235 bytes} [Wed Jun 29 07:56:24 2022] POST /compute/v2.1/flavors => generated 404 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 29 07:56:25.780063 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi [None req-9e8510ea-7f7c-4f5a-aeb6-569deba9f70a admin admin] Calling method '>' {{(pid=103151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 07:56:25.781092 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: INFO nova.api.openstack.requestlog [None req-9e8510ea-7f7c-4f5a-aeb6-569deba9f70a admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001418 Jun 29 07:56:25.781484 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: [pid: 103151|app: 0|req: 27/55] 10.222.0.43 () {56 vars in 1074 bytes} [Wed Jun 29 07:56:25 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 07:56:25.981180 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi [None req-f6176030-40ea-4dce-9b1e-8ea831fbb662 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 07:56:26.002036 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: INFO nova.api.openstack.requestlog [None req-f6176030-40ea-4dce-9b1e-8ea831fbb662 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.074530 Jun 29 07:56:26.002519 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: [pid: 103150|app: 0|req: 29/56] 10.222.0.43 () {64 vars in 1235 bytes} [Wed Jun 29 07:56:25 2022] POST /compute/v2.1/flavors => generated 405 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 29 07:56:26.855598 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi [None req-9e8510ea-7f7c-4f5a-aeb6-569deba9f70a admin admin] Calling method '>' {{(pid=103151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 07:56:26.856943 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: INFO nova.api.openstack.requestlog [None req-9e8510ea-7f7c-4f5a-aeb6-569deba9f70a admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001435 Jun 29 07:56:26.857218 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: [pid: 103151|app: 0|req: 28/57] 10.222.0.43 () {56 vars in 1074 bytes} [Wed Jun 29 07:56:26 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 07:56:27.055940 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi [None req-91e2fbc3-dc2f-4b92-b545-37ac79ee7039 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 07:56:27.074762 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: INFO nova.api.openstack.requestlog [None req-91e2fbc3-dc2f-4b92-b545-37ac79ee7039 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.075789 Jun 29 07:56:27.075238 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: [pid: 103150|app: 0|req: 30/58] 10.222.0.43 () {64 vars in 1235 bytes} [Wed Jun 29 07:56:26 2022] POST /compute/v2.1/flavors => generated 407 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 29 07:56:27.924186 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi [None req-9e8510ea-7f7c-4f5a-aeb6-569deba9f70a admin admin] Calling method '>' {{(pid=103151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 07:56:27.925279 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: INFO nova.api.openstack.requestlog [None req-9e8510ea-7f7c-4f5a-aeb6-569deba9f70a admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001702 Jun 29 07:56:27.925675 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: [pid: 103151|app: 0|req: 29/59] 10.222.0.43 () {56 vars in 1074 bytes} [Wed Jun 29 07:56:27 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 29 07:56:28.120852 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi [None req-a2adce39-8ef2-4c0d-bd4a-d13850eb98de admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 07:56:28.139315 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: INFO nova.api.openstack.requestlog [None req-a2adce39-8ef2-4c0d-bd4a-d13850eb98de admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.074527 Jun 29 07:56:28.139799 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: [pid: 103150|app: 0|req: 31/60] 10.222.0.43 () {64 vars in 1235 bytes} [Wed Jun 29 07:56:28 2022] POST /compute/v2.1/flavors => generated 409 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 29 07:56:29.018569 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi [None req-9e8510ea-7f7c-4f5a-aeb6-569deba9f70a admin admin] Calling method '>' {{(pid=103151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 07:56:29.019587 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: INFO nova.api.openstack.requestlog [None req-9e8510ea-7f7c-4f5a-aeb6-569deba9f70a admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001455 Jun 29 07:56:29.019992 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: [pid: 103151|app: 0|req: 30/61] 10.222.0.43 () {56 vars in 1074 bytes} [Wed Jun 29 07:56:29 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 07:56:29.221481 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi [None req-c40535b8-da47-4d76-9170-e4af0ba6a2af admin admin] Calling method '>' {{(pid=103150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 07:56:29.241695 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: INFO nova.api.openstack.requestlog [None req-c40535b8-da47-4d76-9170-e4af0ba6a2af admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.074404 Jun 29 07:56:29.242287 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: [pid: 103150|app: 0|req: 32/62] 10.222.0.43 () {60 vars in 1202 bytes} [Wed Jun 29 07:56:29 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 07:57:17.046531 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi [None req-9e8510ea-7f7c-4f5a-aeb6-569deba9f70a admin admin] Calling method '>' {{(pid=103151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 07:57:17.047571 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: INFO nova.api.openstack.requestlog [None req-9e8510ea-7f7c-4f5a-aeb6-569deba9f70a admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001505 Jun 29 07:57:17.047971 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: [pid: 103151|app: 0|req: 31/63] 10.222.0.43 () {54 vars in 930 bytes} [Wed Jun 29 07:57:17 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 07:57:17.059064 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG dbcounter [-] [103150] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 07:57:17.107069 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi [None req-785a5775-e42b-4fa4-8f31-c6e71471e4e7 admin admin] Calling method '>' {{(pid=103150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 07:57:17.126804 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: INFO nova.api.openstack.requestlog [None req-785a5775-e42b-4fa4-8f31-c6e71471e4e7 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.072074 Jun 29 07:57:17.127356 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: [pid: 103150|app: 0|req: 33/64] 10.222.0.43 () {60 vars in 1291 bytes} [Wed Jun 29 07:57:17 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 07:57:17.156048 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi [None req-d883ed78-597e-472d-9f34-25b7552e3dba admin admin] Calling method '>' {{(pid=103151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 07:57:17.159574 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG dbcounter [-] [103151] Writing DB stats nova_api:SELECT=14 {{(pid=103151) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 07:57:17.166394 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: INFO nova.api.openstack.requestlog [None req-d883ed78-597e-472d-9f34-25b7552e3dba admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.014058 Jun 29 07:57:17.166945 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: [pid: 103151|app: 0|req: 32/65] 10.222.0.43 () {60 vars in 1282 bytes} [Wed Jun 29 07:57:17 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 07:57:17.179538 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi [None req-c191a349-dcbc-408b-afae-82b7905c5973 admin admin] Calling method '>' {{(pid=103150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 07:57:17.187819 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: INFO nova.api.openstack.requestlog [None req-c191a349-dcbc-408b-afae-82b7905c5973 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012426 Jun 29 07:57:17.188369 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: [pid: 103150|app: 0|req: 34/66] 10.222.0.43 () {60 vars in 1285 bytes} [Wed Jun 29 07:57:17 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 07:57:17.200533 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi [None req-e277c02f-ed5e-460b-86e9-0db5dafbcd7a admin admin] Calling method '>' {{(pid=103151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 07:57:17.208382 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: INFO nova.api.openstack.requestlog [None req-e277c02f-ed5e-460b-86e9-0db5dafbcd7a admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011458 Jun 29 07:57:17.209166 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: [pid: 103151|app: 0|req: 33/67] 10.222.0.43 () {60 vars in 1285 bytes} [Wed Jun 29 07:57:17 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 07:57:17.221370 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi [None req-ff3e2915-04e5-4885-b7cf-0e0414383dd6 admin admin] Calling method '>' {{(pid=103150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 07:57:17.230264 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: INFO nova.api.openstack.requestlog [None req-ff3e2915-04e5-4885-b7cf-0e0414383dd6 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012504 Jun 29 07:57:17.230975 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: [pid: 103150|app: 0|req: 35/68] 10.222.0.43 () {60 vars in 1282 bytes} [Wed Jun 29 07:57:17 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:00:42.866532 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi [None req-e277c02f-ed5e-460b-86e9-0db5dafbcd7a admin admin] Calling method '>' {{(pid=103151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:00:42.867535 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: INFO nova.api.openstack.requestlog [None req-e277c02f-ed5e-460b-86e9-0db5dafbcd7a admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001439 Jun 29 08:00:42.867934 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: [pid: 103151|app: 0|req: 34/69] 10.222.0.43 () {56 vars in 1074 bytes} [Wed Jun 29 08:00:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:00:43.012203 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG dbcounter [-] [103150] Writing DB stats nova_api:SELECT=6 {{(pid=103150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:00:43.124040 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi [None req-403dcfb2-b349-4f18-ac1c-66a27e602987 admin admin] Calling method '>' {{(pid=103150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:00:43.125267 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 29 08:00:43.125267 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: warnings.warn(msg) Jun 29 08:00:43.126525 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG oslo_concurrency.lockutils [None req-403dcfb2-b349-4f18-ac1c-66a27e602987 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:00:43.126997 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG oslo_concurrency.lockutils [None req-403dcfb2-b349-4f18-ac1c-66a27e602987 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:00:43.127784 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG oslo_concurrency.lockutils [None req-403dcfb2-b349-4f18-ac1c-66a27e602987 admin admin] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:00:43.128729 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG oslo_concurrency.lockutils [None req-403dcfb2-b349-4f18-ac1c-66a27e602987 admin admin] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:00:43.162701 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: INFO nova.api.openstack.requestlog [None req-403dcfb2-b349-4f18-ac1c-66a27e602987 admin admin] 10.222.0.43 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.155484 Jun 29 08:00:43.163259 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: [pid: 103150|app: 0|req: 36/70] 10.222.0.43 () {60 vars in 1193 bytes} [Wed Jun 29 08:00:43 2022] GET /compute/v2.1/os-services => generated 794 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 29 08:00:43.997624 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi [None req-e277c02f-ed5e-460b-86e9-0db5dafbcd7a admin admin] Calling method '>' {{(pid=103151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:00:43.998633 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: INFO nova.api.openstack.requestlog [None req-e277c02f-ed5e-460b-86e9-0db5dafbcd7a admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001535 Jun 29 08:00:43.999028 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: [pid: 103151|app: 0|req: 35/71] 10.222.0.43 () {56 vars in 1074 bytes} [Wed Jun 29 08:00:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:00:44.195167 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi [None req-1eaa8b9f-096a-4cba-b896-06a63c59f482 admin admin] Calling method '>' {{(pid=103150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:00:44.196371 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 29 08:00:44.196371 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: warnings.warn(msg) Jun 29 08:00:44.197589 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG oslo_concurrency.lockutils [None req-1eaa8b9f-096a-4cba-b896-06a63c59f482 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:00:44.198029 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG oslo_concurrency.lockutils [None req-1eaa8b9f-096a-4cba-b896-06a63c59f482 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:00:44.198805 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG oslo_concurrency.lockutils [None req-1eaa8b9f-096a-4cba-b896-06a63c59f482 admin admin] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:00:44.199258 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG oslo_concurrency.lockutils [None req-1eaa8b9f-096a-4cba-b896-06a63c59f482 admin admin] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:00:44.218809 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: INFO nova.api.openstack.requestlog [None req-1eaa8b9f-096a-4cba-b896-06a63c59f482 admin admin] 10.222.0.43 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.080099 Jun 29 08:00:44.219369 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: [pid: 103150|app: 0|req: 37/72] 10.222.0.43 () {60 vars in 1193 bytes} [Wed Jun 29 08:00:44 2022] GET /compute/v2.1/os-services => generated 794 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 29 08:00:55.457944 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi [None req-e277c02f-ed5e-460b-86e9-0db5dafbcd7a admin admin] Calling method '>' {{(pid=103151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:00:55.458941 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: INFO nova.api.openstack.requestlog [None req-e277c02f-ed5e-460b-86e9-0db5dafbcd7a admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001410 Jun 29 08:00:55.459340 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: [pid: 103151|app: 0|req: 36/73] 10.222.0.43 () {56 vars in 1074 bytes} [Wed Jun 29 08:00:55 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:00:55.602852 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG dbcounter [-] [103150] Writing DB stats nova_cell0:SELECT=4 {{(pid=103150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:00:55.603599 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG dbcounter [-] [103150] Writing DB stats nova_cell1:SELECT=4 {{(pid=103150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:00:55.604231 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG dbcounter [-] [103150] Writing DB stats nova_api:SELECT=8 {{(pid=103150) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:00:55.654755 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi [None req-cb7850c9-5abb-4b45-9969-08ac6e119eb5 admin admin] Calling method '>' {{(pid=103150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:00:55.655932 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 29 08:00:55.655932 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: warnings.warn(msg) Jun 29 08:00:55.657135 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG oslo_concurrency.lockutils [None req-cb7850c9-5abb-4b45-9969-08ac6e119eb5 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:00:55.657572 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG oslo_concurrency.lockutils [None req-cb7850c9-5abb-4b45-9969-08ac6e119eb5 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:00:55.658343 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG oslo_concurrency.lockutils [None req-cb7850c9-5abb-4b45-9969-08ac6e119eb5 admin admin] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:00:55.658766 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG oslo_concurrency.lockutils [None req-cb7850c9-5abb-4b45-9969-08ac6e119eb5 admin admin] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:00:55.684899 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: INFO nova.api.openstack.requestlog [None req-cb7850c9-5abb-4b45-9969-08ac6e119eb5 admin admin] 10.222.0.43 "GET /compute/v2.1/os-services" status: 200 len: 1014 microversion: 2.90 time: 0.086481 Jun 29 08:00:55.685433 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: [pid: 103150|app: 0|req: 38/74] 10.222.0.43 () {60 vars in 1193 bytes} [Wed Jun 29 08:00:55 2022] GET /compute/v2.1/os-services => generated 1014 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:00:56.544338 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: DEBUG nova.api.openstack.wsgi [None req-e277c02f-ed5e-460b-86e9-0db5dafbcd7a admin admin] Calling method '>' {{(pid=103151) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:00:56.545383 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: INFO nova.api.openstack.requestlog [None req-e277c02f-ed5e-460b-86e9-0db5dafbcd7a admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001427 Jun 29 08:00:56.545779 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: [pid: 103151|app: 0|req: 37/75] 10.222.0.43 () {56 vars in 1074 bytes} [Wed Jun 29 08:00:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:00:56.739976 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG nova.api.openstack.wsgi [None req-1539e39d-d013-44ed-8b4e-1b21fc315d14 admin admin] Calling method '>' {{(pid=103150) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:00:56.741173 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 29 08:00:56.741173 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: warnings.warn(msg) Jun 29 08:00:56.742496 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG oslo_concurrency.lockutils [None req-1539e39d-d013-44ed-8b4e-1b21fc315d14 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:00:56.742942 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG oslo_concurrency.lockutils [None req-1539e39d-d013-44ed-8b4e-1b21fc315d14 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:00:56.743732 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG oslo_concurrency.lockutils [None req-1539e39d-d013-44ed-8b4e-1b21fc315d14 admin admin] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:00:56.744166 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: DEBUG oslo_concurrency.lockutils [None req-1539e39d-d013-44ed-8b4e-1b21fc315d14 admin admin] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103150) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:00:56.766228 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: INFO nova.api.openstack.requestlog [None req-1539e39d-d013-44ed-8b4e-1b21fc315d14 admin admin] 10.222.0.43 "GET /compute/v2.1/os-services" status: 200 len: 1014 microversion: 2.90 time: 0.079546 Jun 29 08:00:56.766810 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: [pid: 103150|app: 0|req: 39/76] 10.222.0.43 () {60 vars in 1193 bytes} [Wed Jun 29 08:00:56 2022] GET /compute/v2.1/os-services => generated 1014 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:01:51.872286 dv-cinder-768105-14-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jun 29 08:01:51.872827 dv-cinder-768105-14-iscsi devstack@n-api.service[103149]: Wed Jun 29 08:01:51 2022 - graceful shutdown triggered... Jun 29 08:01:51.873317 dv-cinder-768105-14-iscsi devstack@n-api.service[103150]: Gracefully killing worker 1 (pid: 103150)... Jun 29 08:01:51.873671 dv-cinder-768105-14-iscsi devstack@n-api.service[103151]: Gracefully killing worker 2 (pid: 103151)... Jun 29 08:01:52.873759 dv-cinder-768105-14-iscsi devstack@n-api.service[103149]: worker 1 buried after 1 seconds Jun 29 08:01:52.874310 dv-cinder-768105-14-iscsi devstack@n-api.service[103149]: worker 2 buried after 1 seconds Jun 29 08:01:52.874310 dv-cinder-768105-14-iscsi devstack@n-api.service[103149]: goodbye to uWSGI. Jun 29 08:01:52.875377 dv-cinder-768105-14-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jun 29 08:01:52.875939 dv-cinder-768105-14-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jun 29 08:01:52.878727 dv-cinder-768105-14-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 29 08:01:52.890723 dv-cinder-768105-14-iscsi devstack@n-api.service[117872]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 29 08:01:52.893280 dv-cinder-768105-14-iscsi devstack@n-api.service[117872]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Jun 29 08:01:52 2022] *** Jun 29 08:01:52.893280 dv-cinder-768105-14-iscsi devstack@n-api.service[117872]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 29 08:01:52.893280 dv-cinder-768105-14-iscsi devstack@n-api.service[117872]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 29 08:01:52.893280 dv-cinder-768105-14-iscsi devstack@n-api.service[117872]: nodename: dv-cinder-768105-14-iscsi Jun 29 08:01:52.893280 dv-cinder-768105-14-iscsi devstack@n-api.service[117872]: machine: x86_64 Jun 29 08:01:52.893280 dv-cinder-768105-14-iscsi devstack@n-api.service[117872]: clock source: unix Jun 29 08:01:52.893280 dv-cinder-768105-14-iscsi devstack@n-api.service[117872]: pcre jit disabled Jun 29 08:01:52.893280 dv-cinder-768105-14-iscsi devstack@n-api.service[117872]: detected number of CPU cores: 4 Jun 29 08:01:52.893280 dv-cinder-768105-14-iscsi devstack@n-api.service[117872]: current working directory: / Jun 29 08:01:52.893280 dv-cinder-768105-14-iscsi devstack@n-api.service[117872]: detected binary path: /usr/bin/uwsgi-core Jun 29 08:01:52.893280 dv-cinder-768105-14-iscsi devstack@n-api.service[117872]: your processes number limit is 47680 Jun 29 08:01:52.893280 dv-cinder-768105-14-iscsi devstack@n-api.service[117872]: your memory page size is 4096 bytes Jun 29 08:01:52.893280 dv-cinder-768105-14-iscsi devstack@n-api.service[117872]: detected max file descriptor number: 2048 Jun 29 08:01:52.893280 dv-cinder-768105-14-iscsi devstack@n-api.service[117872]: lock engine: pthread robust mutexes Jun 29 08:01:52.893280 dv-cinder-768105-14-iscsi devstack@n-api.service[117872]: thunder lock: enabled Jun 29 08:01:52.893280 dv-cinder-768105-14-iscsi devstack@n-api.service[117872]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 29 08:01:52.894464 dv-cinder-768105-14-iscsi devstack@n-api.service[117872]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 29 08:01:52.940546 dv-cinder-768105-14-iscsi devstack@n-api.service[117872]: Python main interpreter initialized at 0x556f561669c0 Jun 29 08:01:52.940546 dv-cinder-768105-14-iscsi devstack@n-api.service[117872]: python threads support enabled Jun 29 08:01:52.940546 dv-cinder-768105-14-iscsi devstack@n-api.service[117872]: your server socket listen backlog is limited to 100 connections Jun 29 08:01:52.940546 dv-cinder-768105-14-iscsi devstack@n-api.service[117872]: your mercy for graceful operations on workers is 90 seconds Jun 29 08:01:52.940995 dv-cinder-768105-14-iscsi devstack@n-api.service[117872]: mapped 403077 bytes (393 KB) for 2 cores Jun 29 08:01:52.940995 dv-cinder-768105-14-iscsi devstack@n-api.service[117872]: *** Operational MODE: preforking *** Jun 29 08:01:52.941300 dv-cinder-768105-14-iscsi devstack@n-api.service[117872]: *** uWSGI is running in multiple interpreter mode *** Jun 29 08:01:52.941300 dv-cinder-768105-14-iscsi devstack@n-api.service[117872]: spawned uWSGI master process (pid: 117872) Jun 29 08:01:52.941510 dv-cinder-768105-14-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 29 08:01:52.943080 dv-cinder-768105-14-iscsi devstack@n-api.service[117872]: spawned uWSGI worker 1 (pid: 117889, cores: 1) Jun 29 08:01:52.943080 dv-cinder-768105-14-iscsi devstack@n-api.service[117872]: spawned uWSGI worker 2 (pid: 117890, cores: 1) Jun 29 08:01:52.943416 dv-cinder-768105-14-iscsi devstack@n-api.service[117872]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 29 08:01:53.621619 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 29 08:01:53.629114 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 29 08:01:54.862406 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 29 08:01:54.862406 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: from cryptography.utils import int_from_bytes Jun 29 08:01:54.863040 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 29 08:01:54.863040 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: from cryptography.utils import int_from_bytes Jun 29 08:01:54.871695 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 29 08:01:54.871695 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: from cryptography.utils import int_from_bytes Jun 29 08:01:54.872208 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 29 08:01:54.872208 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: from cryptography.utils import int_from_bytes Jun 29 08:01:57.265401 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 29 08:01:57.265982 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 29 08:01:57.266187 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 29 08:01:57.266550 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 29 08:01:57.266805 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 29 08:01:57.267192 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:01:57.267515 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:01:57.267837 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:01:57.268160 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:01:57.268489 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:01:57.268803 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:01:57.269148 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:01:57.269467 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:01:57.269790 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:01:57.270051 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:01:57.270362 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:01:57.270756 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-768105-14-iscsi {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:01:57.271015 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:01:57.271324 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:01:57.271634 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:01:57.271950 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:01:57.272256 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:01:57.272573 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:01:57.272876 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:01:57.273415 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:01:57.273625 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 29 08:01:57.274054 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:01:57.274147 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 29 08:01:57.274228 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:01:57.274375 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 29 08:01:57.274500 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:01:57.274775 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:01:57.275160 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:01:57.275278 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 29 08:01:57.275706 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:01:57.275791 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 29 08:01:57.275870 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:01:57.275951 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:01:57.276086 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:01:57.276198 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:01:57.276472 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:01:57.276581 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:01:57.276662 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:01:57.276742 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:01:57.277089 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-768105-14-iscsi {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:01:57.277249 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:01:57.277395 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:01:57.277543 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:01:57.277722 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:01:57.277911 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:01:57.278009 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:01:57.278108 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:01:57.278369 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:01:57.278486 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:01:57.278624 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:01:57.278727 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:01:57.278937 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:01:57.279036 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:01:57.279262 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-768105-14-iscsi {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:01:57.279375 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:01:57.279581 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:01:57.279674 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:01:57.279885 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:01:57.279982 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:01:57.280195 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:01:57.280300 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:01:57.280509 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:01:57.280613 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:01:57.280813 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:01:57.280910 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:01:57.281162 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:01:57.281274 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:01:57.281464 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:01:57.281567 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:01:57.281774 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:01:57.281966 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:01:57.282070 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:01:57.282276 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:01:57.282435 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:01:57.282583 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:01:57.282724 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:01:57.282892 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:01:57.283043 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:01:57.283174 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:01:57.283285 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:01:57.283482 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:01:57.283594 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:01:57.283805 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:01:57.283923 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:01:57.284121 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:01:57.284223 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:01:57.284427 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:01:57.284519 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:01:57.284677 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:01:57.284788 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:01:57.284924 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:01:57.285058 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:01:57.285265 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:01:57.285453 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-768105-14-iscsi {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:01:57.285626 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:01:57.285796 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:01:57.285946 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:01:57.286098 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:01:57.286238 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:01:57.286394 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:01:57.286533 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:01:57.286755 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:01:57.286942 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:01:57.287097 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:01:57.287238 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:01:57.287393 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:01:57.287539 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:01:57.287687 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:01:57.287827 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:01:57.287966 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:01:57.288116 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:01:57.288263 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:01:57.288439 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:01:57.288578 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:01:57.288676 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:01:57.288846 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:01:57.288947 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:01:57.289179 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:01:57.289297 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:01:57.289503 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:01:57.289614 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:01:57.289804 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:01:57.289946 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.43 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:01:57.290112 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:01:57.290210 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.43 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:01:57.290420 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:01:57.290515 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:01:57.290736 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:01:57.290839 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:01:57.291041 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:01:57.291140 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:01:57.291342 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:01:57.291444 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:01:57.291590 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:01:57.291697 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:01:57.291923 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:01:57.292064 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:01:57.292242 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:01:57.292515 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:01:57.292621 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:01:57.292834 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:01:57.292959 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:01:57.293124 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:01:57.293234 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:01:57.293373 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:01:57.293493 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:01:57.293690 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:01:57.293791 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:01:57.294007 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:01:57.294109 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:01:57.294313 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:01:57.294420 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:01:57.294618 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:01:57.294719 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:01:57.294923 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:01:57.295033 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:01:57.295228 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:01:57.295333 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:01:57.295546 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:01:57.295643 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:01:57.295838 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:01:57.295937 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:01:57.296139 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:01:57.296239 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:01:57.296440 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:01:57.296538 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:01:57.296748 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:01:57.296851 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:01:57.297079 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:01:57.297176 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:01:57.297387 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:01:57.297481 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:01:57.297691 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:01:57.297781 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:01:57.297996 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:01:57.298087 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:01:57.298301 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:01:57.298394 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.43 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:01:57.298611 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:01:57.298787 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.43 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:01:57.298982 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:01:57.299121 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:01:57.299299 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:01:57.299461 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:01:57.299700 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:01:57.299877 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:01:57.300024 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:01:57.300169 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:01:57.300572 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:01:57.300718 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:01:57.300868 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:01:57.301071 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:01:57.301223 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:01:57.301376 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:01:57.301529 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:01:57.301674 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:01:57.301825 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:01:57.301988 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:01:57.302141 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:01:57.302293 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:01:57.302464 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:01:57.302681 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:01:57.302681 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:01:57.303069 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:01:57.303221 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:01:57.303365 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:01:57.303524 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:01:57.303669 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:01:57.305023 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:01:57.305124 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:01:57.305212 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:01:57.305324 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:01:57.305422 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:01:57.305519 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:01:57.305605 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:01:57.305715 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:01:57.305811 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:01:57.305910 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:01:57.306003 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:01:57.306095 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:01:57.306188 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:01:57.306273 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:01:57.306357 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:01:57.306449 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:01:57.306535 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:01:57.306614 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:01:57.306705 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:01:57.306796 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:01:57.313188 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:01:57.313322 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:01:57.313417 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:01:57.313515 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:01:57.313606 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:01:57.313701 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:01:57.313798 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:01:57.313885 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:01:57.313971 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:01:57.314056 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:01:57.314140 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:01:57.314236 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:01:57.314331 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:01:57.314417 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:01:57.314508 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:01:57.314508 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:01:57.314508 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:01:57.314508 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:01:57.314508 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:01:57.314907 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:01:57.315007 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:01:57.315101 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:01:57.315195 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:01:57.315281 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:01:57.315281 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:01:57.315433 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:01:57.315519 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:01:57.315612 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:01:57.315705 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.315846 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:01:57.315978 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.316118 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:01:57.316248 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.316385 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:01:57.316514 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.316649 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:01:57.316779 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.317645 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:01:57.317645 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:01:57.317930 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.318070 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:01:57.318207 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.318919 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:01:57.319057 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.319193 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:01:57.319325 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.319462 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:01:57.319592 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.319704 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:01:57.319823 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.320004 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:01:57.320145 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.320275 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:01:57.320760 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.320898 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:01:57.321149 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.321301 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:01:57.321433 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.321570 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:01:57.321702 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.321839 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:01:57.322115 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.322393 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:01:57.322528 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.322647 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:01:57.322758 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.323017 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:01:57.323668 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.323791 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:01:57.323909 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.324028 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:01:57.324141 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.324263 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 29 08:01:57.324384 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.324519 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.324689 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.324816 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.324945 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.325108 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.325254 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.325408 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.325555 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.325674 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.325803 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.325932 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.325932 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.326190 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.326329 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.326466 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.326584 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.326694 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.326888 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.327009 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.327152 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.327376 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.327597 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.327724 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.327850 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.327963 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.328080 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.328199 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.328318 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.328436 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.328583 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.328583 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.328841 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.328841 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.329157 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.329157 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.329408 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.329533 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.329662 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.329817 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.329959 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.330099 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.330234 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.330371 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.330515 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.330734 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.330873 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.331020 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.331150 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.331268 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.331386 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.331503 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.331795 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.331939 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.332076 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.332076 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.332340 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.332564 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.332818 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.332987 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.333181 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.333526 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.333657 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.333771 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.333896 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.334018 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.334138 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.334284 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.334421 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.334559 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.334699 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.334811 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.334921 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.335031 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.335151 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.335264 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.335388 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.335513 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.335632 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.335750 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.335861 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.335979 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.336099 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.336211 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.336321 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.336431 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.336549 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.336669 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.336788 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.336900 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.337077 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.337202 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.337202 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.337202 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.337773 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.337911 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.337911 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.338155 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.338284 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.338427 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.338581 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.338749 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.339440 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.339586 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.339733 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.339864 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.339993 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.340123 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.340251 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.340389 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.340525 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.340655 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.340890 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.345310 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.345471 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.345629 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.345760 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.345886 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.346009 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.346124 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.346245 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.346372 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.346493 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.346614 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.346614 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.346871 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.347006 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.347148 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.347246 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.347246 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.347435 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.347537 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.347640 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.347722 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.347866 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.347866 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.348226 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.348358 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.348501 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.348622 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.348753 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.348857 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.348944 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.349058 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.349166 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.349250 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.349386 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.349521 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.349651 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.349809 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.349959 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.350096 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.350232 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.350368 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.350506 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.350652 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.350788 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.350928 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.351149 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.351283 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.351421 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.351554 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.351693 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.351822 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.351939 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.351939 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.352157 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.352279 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.352398 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.352518 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.352518 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.352671 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.352761 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.352848 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.352934 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.353069 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.353217 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.353354 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.353458 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.353587 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.353724 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.353724 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.353724 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.353724 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.353724 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.353724 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.353724 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.353724 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.354436 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.354436 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.354436 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.354436 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.354436 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.354436 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.354436 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.354436 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.355440 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.355440 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.355440 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.355440 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.355440 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.355440 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.356168 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.356168 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.356410 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.356643 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.356965 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.357182 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.357387 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.357612 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.357912 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.358084 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.358356 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.358516 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.358891 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.359119 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.359280 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.359456 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.359752 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.359926 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.360073 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.360216 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.360368 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.360714 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.360868 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.361085 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.361350 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.361521 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.361668 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.361812 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.361972 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.362125 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.362270 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.362493 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.362810 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.362964 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.363154 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.363425 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.363582 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.363727 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.363967 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.364126 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.364326 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.364475 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.364640 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.364834 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.365043 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.365224 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.365384 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.365647 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.365805 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.365951 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.366253 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.366453 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.366618 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.366618 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.366943 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.367094 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.367272 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.367437 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.367590 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.367743 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.367743 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.368033 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.368186 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.368455 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.368607 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.368607 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.368892 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.369197 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.369342 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.369499 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.369644 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.370303 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.370557 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.370775 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.370963 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.370963 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.371381 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.371543 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.371696 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.371856 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.372016 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.372234 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.372393 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.372639 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.372825 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.373021 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.373210 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.373378 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.373586 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.373748 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.373922 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.374074 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.374231 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.374382 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.374527 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.374670 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.374821 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.374965 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.375121 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.375307 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.375489 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.375742 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.375909 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.376069 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.376261 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.376420 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.376624 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.376769 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.376927 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.377150 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.377300 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.377442 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.377593 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.377836 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.378009 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.378164 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.378314 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.378474 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.378757 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.378997 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.379173 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.379429 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.379614 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.379772 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.379917 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.380060 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.380217 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.380376 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.380536 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.380680 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.380831 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.381088 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.381284 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.381457 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.381690 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.381841 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.381992 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.382146 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.382338 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.382490 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.382671 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.382839 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.382985 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.383159 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.383327 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.383511 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.383698 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.383899 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.384050 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.384227 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.384470 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.384620 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.384827 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.385033 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.385209 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.385421 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.386306 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.386518 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.386826 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.386991 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.387233 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.387394 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.387569 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.387771 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.387932 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.388090 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.388242 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.388394 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.388547 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.388711 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.388938 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.389141 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.389297 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.389460 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.389704 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.389857 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.390011 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.390165 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.390320 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.390465 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.390465 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.390739 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.390892 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.391037 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.391181 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.391333 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.391494 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.391755 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.391908 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.392060 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.392214 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.392377 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.392530 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.392684 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.392829 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.392992 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.393144 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.393289 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.393476 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.393635 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.393781 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.393925 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.394069 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.394221 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.394451 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.394451 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.394743 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.394896 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.395040 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.395191 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.395389 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.395550 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.395696 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.395840 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.395991 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.396135 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.396318 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.396541 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.396691 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.396850 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.397056 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.397219 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.397388 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.397388 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.397698 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.397844 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.398001 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.398153 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.398306 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.398459 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.398645 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.398800 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.398972 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.399246 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.399390 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.399534 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.399806 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.399968 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.400114 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.400265 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.400418 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.400562 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.400721 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.400943 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.401215 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.401488 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.401643 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.402015 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.402015 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.402015 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.402457 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.402611 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.402772 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.402917 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.403074 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.403231 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.403382 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.403534 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.403534 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.403824 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.403980 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.404125 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.404268 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.404412 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.404555 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.404705 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.404863 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.405048 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.405206 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.405351 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.405494 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.405651 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.405797 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.405949 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.406100 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.406244 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.406397 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.406573 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.406805 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.406962 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.407126 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.407126 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.407409 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.407564 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.407725 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.407912 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.408069 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.408214 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.408370 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.408523 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.408668 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.408812 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.408962 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.409195 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.409432 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.409623 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.409623 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.410039 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.410201 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.410354 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.410514 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.410659 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.410811 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.410971 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.411147 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.411295 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.411464 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.411617 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.411763 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.411906 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.412170 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.412339 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.412494 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.412645 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.412790 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.412941 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.413123 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.413319 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.413488 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.413640 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.413792 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.413792 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.414081 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.414239 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.414393 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.414537 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.414687 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.414832 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.414975 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.415129 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.415273 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.415435 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.415579 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.415736 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.415919 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.416077 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.416222 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.416367 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.416517 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.417315 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.417653 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.417863 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.418052 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.418198 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.418198 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.418503 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.418676 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.418676 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.418676 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.419300 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.419540 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.419693 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.419852 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.420023 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.420265 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.420265 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.420553 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.420710 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.420868 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.421031 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.421191 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.421336 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.421487 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.421647 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.421647 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.421921 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.422072 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.422317 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.422468 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.422623 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.422786 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.422940 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.423085 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.423253 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.423488 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.423647 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.423794 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.423947 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.424098 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.424250 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.424394 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.424552 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.424709 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.424897 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.425118 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.425521 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.425683 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.425829 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.425973 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.426123 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.426275 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.426419 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.426575 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.426720 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.426864 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.426864 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.427157 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.427320 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.427556 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.427707 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.427855 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.427978 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.428090 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.428203 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.428203 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.428440 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.428552 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.428672 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.428792 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.428920 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.429083 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.429216 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.429357 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.429357 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.429698 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.429840 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.429969 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.430241 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.430397 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.430643 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.430814 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.431266 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.431415 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.431415 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.431670 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.431806 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.431980 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.432206 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.433031 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.433315 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.433622 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.433853 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.434042 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.434341 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.434483 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.434649 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.434843 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.434984 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.435268 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.435410 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.435594 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.435798 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.435957 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.436201 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.436348 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.436512 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.436837 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.437052 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.437229 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.437385 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.437543 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.437771 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.437910 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.438076 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.438304 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.438448 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.438707 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.438863 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.439043 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.439312 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.439467 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.439757 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.440000 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.440141 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.440366 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.440498 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.440746 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.440929 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.441768 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.441914 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.442046 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.442046 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.442299 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.442443 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.442573 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.442718 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.442718 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.443282 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.443430 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.443561 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.443699 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.443699 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.443977 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.444114 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.444114 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.444373 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.444509 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.444645 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.444782 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.444912 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.445178 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.445352 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.445513 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.445686 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.445827 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.446124 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.446270 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.446442 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.446624 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.446758 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.447054 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.447231 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.447364 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.447654 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.447802 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.448063 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.448277 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.448621 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.448819 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.448963 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.449270 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.449518 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.449664 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.449920 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.450148 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.450297 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.450548 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.450691 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.450948 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.451102 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.451264 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.451488 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.451620 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.451812 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.451996 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.452158 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.452414 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.452611 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.452745 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.453032 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.453258 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.453404 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.453630 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.453763 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.453938 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.454240 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.454379 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.454543 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.454766 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.454902 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.455152 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.455325 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.455450 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.455703 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.455844 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.456058 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.456294 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.456435 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.456654 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.456791 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.456957 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.457321 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.457467 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.457633 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.457924 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.458085 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.458294 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.458564 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.458894 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.459095 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.459229 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.459552 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.459693 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.459902 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.460136 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.460295 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.460438 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.460689 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.460822 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.461111 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.461267 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.461400 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.461623 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.461760 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.461971 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.462143 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.462278 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.462579 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.462720 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.462895 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.463062 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.463453 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.463655 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.463795 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.464112 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.464527 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.464675 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.464847 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.465189 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.465323 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.465507 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.465738 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.465881 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.466117 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.466353 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.466563 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.466712 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.466849 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.467045 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.467369 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.467538 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.467699 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.467992 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.468135 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.468919 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.469097 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.469230 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.469371 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.469503 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.469756 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.469894 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.469894 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.470164 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.470371 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.470371 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.470635 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.470764 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.470902 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.471030 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.471160 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.471398 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.471540 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.471725 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.471953 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.472094 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.472351 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.472491 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.472664 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.472859 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.473015 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.473293 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.473525 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.473674 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.473804 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.473934 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.474243 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.474385 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.474561 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.474743 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.474887 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.475239 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.475389 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.475554 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.475846 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.476016 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.476299 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.476432 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.476653 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.476910 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.477110 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.477363 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.477504 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.477643 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.477904 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.478048 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.478243 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.478403 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.478536 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.478842 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.479060 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.479713 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.480252 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.480527 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.480845 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.484612 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.484612 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.484903 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.485096 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.485230 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.485476 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.485609 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.485609 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.485964 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.486122 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.486271 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.486972 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.487090 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.487187 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.487271 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.487353 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.487427 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.487498 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.487576 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.487576 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.487576 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.487576 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.487576 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.487576 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.487576 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.487576 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.488102 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.488102 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.488102 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.488102 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.488405 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.488502 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.493003 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.493003 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.493003 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.493003 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.493003 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.493003 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.493003 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.493003 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.494121 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.494121 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.494121 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.494377 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.494466 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.494551 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.494637 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.494724 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.494828 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.494982 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.495069 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.495390 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.495859 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.495979 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.496069 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.496161 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.496254 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.496254 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.496416 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.496509 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.496601 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.496687 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.496777 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.496861 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.496861 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.497047 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.497154 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.497249 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.497342 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.497427 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.497529 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.497615 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.497699 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.497781 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.497781 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.497938 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.498019 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.498093 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.498170 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.498242 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.498311 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.498388 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.498537 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.498619 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.501040 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.501245 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.501412 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.501579 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.501739 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.501895 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.502043 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.502198 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.502346 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.502502 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.502650 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.502802 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.502948 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.503093 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.503249 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.503414 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.503568 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.503721 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.503867 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.504029 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.504190 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.504337 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.504483 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.504635 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.504987 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.505157 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.505325 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.505471 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.505635 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.505868 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.506027 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.506174 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.506329 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.506482 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.506636 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.506783 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.506936 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.507092 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.507245 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.507450 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.507602 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.507748 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.507892 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.508065 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.508282 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.508440 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.508620 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.508767 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.508913 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.509098 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.509303 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.509303 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.509686 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.509841 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.510023 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.510201 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.511118 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.511275 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.511421 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.511566 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.511721 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.511721 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.511999 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.512145 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.512307 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.512462 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.512621 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.512768 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.512929 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.513107 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.513255 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.513407 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.513565 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.513711 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.513855 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.514008 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.514160 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.514160 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.514160 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.514607 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.514766 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.515090 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.515253 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.515410 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.515556 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.515702 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.515865 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.515865 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.516244 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.516417 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.516565 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.516710 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.516854 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.517028 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.517180 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.517344 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.517497 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.517652 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.517798 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.517943 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.518096 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.518257 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.518257 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.518634 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.518790 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.518944 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.519100 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.519253 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.519406 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.519577 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.519804 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.519956 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.520118 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.520118 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.520433 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.520657 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.520808 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.520962 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.521351 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.521507 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.521652 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.521805 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.521951 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.522110 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.522110 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.522400 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.522553 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.522708 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.522861 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.523016 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.523171 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.523323 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.523476 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.523628 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.523782 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.523935 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.524096 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.524339 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.524494 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.524691 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.524849 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.525019 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.525377 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.525540 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.525687 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.525831 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.526073 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.526351 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.526506 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.526657 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.526812 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.526977 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.527137 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.527284 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.527430 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.527576 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.527721 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.527875 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.528028 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.528028 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.528312 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.528478 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.528701 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.528862 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.529049 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.529200 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.529345 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.529498 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.529652 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.529825 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.530043 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.530202 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.530202 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.530202 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.530647 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.530876 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.531039 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.531446 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.531607 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.531763 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.531988 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.532145 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.532291 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.532437 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.532581 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.532727 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.532882 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.533057 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.533208 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.533371 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.533516 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.533675 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.533823 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.533969 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.534122 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.534275 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.534432 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.534592 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.534738 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.534885 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.535029 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.535185 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.538028 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.538223 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.538381 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.538531 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.538707 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.538944 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.538944 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.539241 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.539389 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.539541 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.539687 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.539838 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.540026 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.540258 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.540409 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.540562 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.540745 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.540999 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.541171 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.541584 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.542283 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.542283 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 29 08:01:57.542563 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.542563 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.542563 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.542563 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.542563 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.542563 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.542563 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.542563 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.543689 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.543689 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.543689 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.543689 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.543689 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.543689 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.543689 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.543689 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.544813 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.544813 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.544813 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.544813 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.544813 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.544813 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.544813 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.544813 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.546651 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.546651 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.546651 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.546651 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.546651 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.546651 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.546651 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.546651 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.548084 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.548084 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.548084 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.548084 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.548084 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.548084 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.548084 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.549187 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.549187 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.549471 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.549616 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.549942 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.550564 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.550817 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.551130 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.551769 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.551769 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.552074 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.552441 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.552769 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.553108 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.553425 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.553748 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.554059 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.554372 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.554686 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.555005 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.555320 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.555710 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.555952 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.556374 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.556708 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.557066 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.557653 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.558561 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.558885 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.559236 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.559665 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.560366 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.560703 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.561069 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.561404 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.561724 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.562265 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.562593 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.562921 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.563252 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.563570 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.563899 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.564228 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.564546 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.564875 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.565291 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.565629 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.565978 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.566315 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.566656 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.566958 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.567269 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.567580 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.567895 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.568219 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.568535 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.568842 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.569177 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.569494 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.569804 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.570114 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.570423 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.570727 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.571043 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.571343 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.571650 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.571956 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.572262 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.572570 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.573391 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.574235 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.574563 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.574890 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.575205 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.575528 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.575872 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.576219 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.576563 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.576889 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.577245 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.577567 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.577900 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.578217 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.578550 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.578877 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.579208 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.579524 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.579864 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.580190 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.580503 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.580822 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.581180 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.581506 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.581810 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.582161 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.582494 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.582806 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.583138 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.583463 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.583787 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.584108 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.584487 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.584826 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.585167 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.586616 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.586616 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.586616 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.586616 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.587208 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.587208 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.587484 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.587625 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.587941 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.588269 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.589432 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.589948 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.590170 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.590611 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.590866 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.591191 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.591505 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.591818 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 29 08:01:57.592062 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 29 08:01:57.599565 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO dbcounter [None req-2345246a-c7b5-4b01-aeb7-49e06938560f None None] Registered counter for database nova_api Jun 29 08:01:57.619708 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_db.sqlalchemy.engines [None req-2345246a-c7b5-4b01-aeb7-49e06938560f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117890) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 29 08:01:57.626535 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG dbcounter [-] [117890] Writer thread running {{(pid=117890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 29 08:01:57.661775 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO dbcounter [None req-4c3b5b81-93be-4da1-b63f-4c5dad9bd666 None None] Registered counter for database nova_api Jun 29 08:01:57.683207 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_db.sqlalchemy.engines [None req-4c3b5b81-93be-4da1-b63f-4c5dad9bd666 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117889) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 29 08:01:57.684132 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.context [None req-2345246a-c7b5-4b01-aeb7-49e06938560f None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),dbb7898a-7253-4700-b659-bf676ac566bb(cell1) {{(pid=117890) load_cells /opt/stack/nova/nova/context.py:464}} Jun 29 08:01:57.688284 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-2345246a-c7b5-4b01-aeb7-49e06938560f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:01:57.689929 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writer thread running {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 29 08:01:57.690118 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-2345246a-c7b5-4b01-aeb7-49e06938560f None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:01:57.690709 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-2345246a-c7b5-4b01-aeb7-49e06938560f None None] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:01:57.692670 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-2345246a-c7b5-4b01-aeb7-49e06938560f None None] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:01:57.694681 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO dbcounter [None req-2345246a-c7b5-4b01-aeb7-49e06938560f None None] Registered counter for database nova_cell0 Jun 29 08:01:57.699413 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO dbcounter [None req-2345246a-c7b5-4b01-aeb7-49e06938560f None None] Registered counter for database nova_cell1 Jun 29 08:01:57.706716 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_db.sqlalchemy.engines [None req-2345246a-c7b5-4b01-aeb7-49e06938560f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117890) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 29 08:01:57.709178 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_db.sqlalchemy.engines [None req-2345246a-c7b5-4b01-aeb7-49e06938560f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117890) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 29 08:01:57.714943 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG dbcounter [-] [117890] Writer thread running {{(pid=117890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 29 08:01:57.717448 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG dbcounter [-] [117890] Writer thread running {{(pid=117890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 29 08:01:57.749059 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.context [None req-4c3b5b81-93be-4da1-b63f-4c5dad9bd666 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),dbb7898a-7253-4700-b659-bf676ac566bb(cell1) {{(pid=117889) load_cells /opt/stack/nova/nova/context.py:464}} Jun 29 08:01:57.753227 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-4c3b5b81-93be-4da1-b63f-4c5dad9bd666 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:01:57.754829 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-4c3b5b81-93be-4da1-b63f-4c5dad9bd666 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:01:57.755632 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-4c3b5b81-93be-4da1-b63f-4c5dad9bd666 None None] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:01:57.757706 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-4c3b5b81-93be-4da1-b63f-4c5dad9bd666 None None] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:01:57.759699 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO dbcounter [None req-4c3b5b81-93be-4da1-b63f-4c5dad9bd666 None None] Registered counter for database nova_cell0 Jun 29 08:01:57.764576 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO dbcounter [None req-4c3b5b81-93be-4da1-b63f-4c5dad9bd666 None None] Registered counter for database nova_cell1 Jun 29 08:01:57.771738 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_db.sqlalchemy.engines [None req-4c3b5b81-93be-4da1-b63f-4c5dad9bd666 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117889) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 29 08:01:57.774089 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_db.sqlalchemy.engines [None req-4c3b5b81-93be-4da1-b63f-4c5dad9bd666 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117889) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 29 08:01:57.781876 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writer thread running {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 29 08:01:57.783182 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writer thread running {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 29 08:01:57.863794 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO dbcounter [None req-2345246a-c7b5-4b01-aeb7-49e06938560f None None] Registered counter for database nova_cell0 Jun 29 08:01:57.871436 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_db.sqlalchemy.engines [None req-2345246a-c7b5-4b01-aeb7-49e06938560f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117890) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 29 08:01:57.875844 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG dbcounter [-] [117890] Writer thread running {{(pid=117890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 29 08:01:57.930262 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO dbcounter [None req-4c3b5b81-93be-4da1-b63f-4c5dad9bd666 None None] Registered counter for database nova_cell0 Jun 29 08:01:57.937565 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_db.sqlalchemy.engines [None req-4c3b5b81-93be-4da1-b63f-4c5dad9bd666 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117889) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 29 08:01:57.941930 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writer thread running {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 29 08:01:58.196755 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: WARNING keystonemiddleware.auth_token [None req-2345246a-c7b5-4b01-aeb7-49e06938560f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 29 08:01:58.204183 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: WARNING keystonemiddleware.auth_token [None req-2345246a-c7b5-4b01-aeb7-49e06938560f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 29 08:01:58.264746 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: WARNING keystonemiddleware.auth_token [None req-4c3b5b81-93be-4da1-b63f-4c5dad9bd666 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 29 08:01:58.272170 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: WARNING keystonemiddleware.auth_token [None req-4c3b5b81-93be-4da1-b63f-4c5dad9bd666 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 29 08:01:58.553166 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: WARNING keystonemiddleware.auth_token [None req-2345246a-c7b5-4b01-aeb7-49e06938560f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 29 08:01:58.561382 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: WARNING keystonemiddleware.auth_token [None req-2345246a-c7b5-4b01-aeb7-49e06938560f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 29 08:01:58.566777 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x556f561669c0 pid: 117890 (default app) Jun 29 08:01:58.616867 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: WARNING keystonemiddleware.auth_token [None req-4c3b5b81-93be-4da1-b63f-4c5dad9bd666 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 29 08:01:58.623555 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: WARNING keystonemiddleware.auth_token [None req-4c3b5b81-93be-4da1-b63f-4c5dad9bd666 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 29 08:01:58.629019 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x556f561669c0 pid: 117889 (default app) Jun 29 08:02:51.803432 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG dbcounter [-] [117890] Writing DB stats nova_api:SELECT=3 {{(pid=117890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:02:51.805981 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG dbcounter [-] [117890] Writing DB stats nova_cell1:SELECT=3 {{(pid=117890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:02:51.809432 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG dbcounter [-] [117890] Writing DB stats nova_cell0:SELECT=3 {{(pid=117890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:02:51.810796 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG dbcounter [-] [117890] Writing DB stats nova_cell0:SELECT=3 {{(pid=117890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:02:53.099613 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-d19b7751-8306-4082-8186-6d295aacdc72 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1022703827", "imageRef": "5d2148a0-3628-4eff-88e9-5686abc0d33e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:02:54.222631 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.network.neutron [None req-d19b7751-8306-4082-8186-6d295aacdc72 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] validate_networks() for [('6d288728-176e-477c-8692-ca82d6facbbc', None, None, None, None, None)] {{(pid=117890) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 29 08:02:58.328740 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_api:SELECT=3 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:02:58.331506 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_cell0:SELECT=3 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:02:58.336037 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_cell1:SELECT=3 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:02:58.351128 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_cell0:SELECT=3 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:02:59.110076 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-b0b1fcb3-7049-46e9-b93c-1b52644da934 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Action: 'create', calling method: .version_select at 0x7f72433303a0>, body: {"keypair": {"name": "tempest-keypair-1021976267", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO06M4k3AE/oLk//meQRBDHJzrjYmj2f+Kt7+n/gIw10zgx0+6SLheXYt52GuABRL962yGbesEoNxBVTFJsb3tiO+X/A7j9HKFeNZzGfgP/yvaZizKQPEEQz5iSdu7Al0A=="}} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:02:59.138045 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.virt.hardware [None req-d19b7751-8306-4082-8186-6d295aacdc72 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Flavor limits 0:0:0 {{(pid=117890) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 29 08:02:59.138516 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.virt.hardware [None req-d19b7751-8306-4082-8186-6d295aacdc72 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Image limits 0:0:0 {{(pid=117890) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 29 08:02:59.138963 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.virt.hardware [None req-d19b7751-8306-4082-8186-6d295aacdc72 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Flavor pref 0:0:0 {{(pid=117890) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 29 08:02:59.139482 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.virt.hardware [None req-d19b7751-8306-4082-8186-6d295aacdc72 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Image pref 0:0:0 {{(pid=117890) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 29 08:02:59.140087 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.virt.hardware [None req-d19b7751-8306-4082-8186-6d295aacdc72 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117890) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 29 08:02:59.171620 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-d19b7751-8306-4082-8186-6d295aacdc72 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:02:59.172096 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-d19b7751-8306-4082-8186-6d295aacdc72 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:02:59.173199 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-d19b7751-8306-4082-8186-6d295aacdc72 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:02:59.173466 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-d19b7751-8306-4082-8186-6d295aacdc72 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:02:59.234702 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.quota [None req-d19b7751-8306-4082-8186-6d295aacdc72 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Getting quotas for project ab693125979f4bb7b7b3c94061610fe2. Resources: {'ram', 'instances', 'cores'} {{(pid=117890) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 29 08:02:59.254967 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.quota [None req-d19b7751-8306-4082-8186-6d295aacdc72 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Getting quotas for user 1f4af4eedee24897be2e702ef51873b3 and project ab693125979f4bb7b7b3c94061610fe2. Resources: {'ram', 'instances', 'cores'} {{(pid=117890) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 29 08:02:59.270435 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-d19b7751-8306-4082-8186-6d295aacdc72 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Going to run 1 instances... {{(pid=117890) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 29 08:02:59.275539 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-d19b7751-8306-4082-8186-6d295aacdc72 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] [instance: 79765057-c430-4292-bc5f-ee0c6a66b367] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5d2148a0-3628-4eff-88e9-5686abc0d33e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117890) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 29 08:02:59.277872 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.quota [None req-b0b1fcb3-7049-46e9-b93c-1b52644da934 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Getting quotas for project 5e0c37d941434569b3dbd07e22125210. Resources: {'key_pairs'} {{(pid=117889) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 29 08:02:59.325177 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.quota [None req-b0b1fcb3-7049-46e9-b93c-1b52644da934 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Getting quotas for user c70c44993ab240b1a5231df4c9d550c9 and project 5e0c37d941434569b3dbd07e22125210. Resources: {'key_pairs'} {{(pid=117889) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 29 08:02:59.522684 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-b0b1fcb3-7049-46e9-b93c-1b52644da934 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.208471 Jun 29 08:02:59.531673 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 1/1] 10.222.0.43 () {60 vars in 1158 bytes} [Wed Jun 29 08:02:58 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1219 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:02:59.655074 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-d19b7751-8306-4082-8186-6d295aacdc72 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 7.857781 Jun 29 08:02:59.661456 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 1/2] 10.222.0.43 () {60 vars in 1146 bytes} [Wed Jun 29 08:02:51 2022] POST /compute/v2.1/servers => generated 383 bytes in 7865 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 29 08:02:59.669120 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-20ac887a-b53c-4924-8443-4bd638a77753 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:02:59.670445 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-20ac887a-b53c-4924-8443-4bd638a77753 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] [instance: 79765057-c430-4292-bc5f-ee0c6a66b367] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:03:00.858861 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-a07231e6-d283-40fb-b49e-481d21a96934 tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-765476993", "imageRef": "5d2148a0-3628-4eff-88e9-5686abc0d33e", "flavorRef": "452", "networks": [{"uuid": "11928363-ada8-4b50-83d3-967220ca2d99"}]}} {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:03:00.974761 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.network.neutron [None req-a07231e6-d283-40fb-b49e-481d21a96934 tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] validate_networks() for [('11928363-ada8-4b50-83d3-967220ca2d99', None, None, None, None, None)] {{(pid=117890) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 29 08:03:01.020687 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-20ac887a-b53c-4924-8443-4bd638a77753 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4af4eedee24897be2e702ef51873b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab693125979f4bb7b7b3c94061610fe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:03:01.069167 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-20ac887a-b53c-4924-8443-4bd638a77753 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] 10.222.0.43 "GET /compute/v2.1/servers/79765057-c430-4292-bc5f-ee0c6a66b367" status: 200 len: 1222 microversion: 2.1 time: 1.406549 Jun 29 08:03:01.086918 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 2/3] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:02:59 2022] GET /compute/v2.1/servers/79765057-c430-4292-bc5f-ee0c6a66b367 => generated 1222 bytes in 1425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:03:01.395492 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-32c770f9-182b-4d96-9373-2d047b455f5d tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-31882052", "imageRef": "5d2148a0-3628-4eff-88e9-5686abc0d33e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:03:01.646364 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.network.neutron [None req-32c770f9-182b-4d96-9373-2d047b455f5d tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] validate_networks() for [('6d288728-176e-477c-8692-ca82d6facbbc', None, None, None, None, None)] {{(pid=117889) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 29 08:03:03.481111 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.virt.hardware [None req-a07231e6-d283-40fb-b49e-481d21a96934 tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] Flavor limits 0:0:0 {{(pid=117890) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 29 08:03:03.481844 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.virt.hardware [None req-a07231e6-d283-40fb-b49e-481d21a96934 tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] Image limits 0:0:0 {{(pid=117890) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 29 08:03:03.482776 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.virt.hardware [None req-a07231e6-d283-40fb-b49e-481d21a96934 tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] Flavor pref 0:0:0 {{(pid=117890) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 29 08:03:03.484215 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.virt.hardware [None req-a07231e6-d283-40fb-b49e-481d21a96934 tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] Image pref 0:0:0 {{(pid=117890) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 29 08:03:03.484904 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.virt.hardware [None req-a07231e6-d283-40fb-b49e-481d21a96934 tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117890) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 29 08:03:03.530589 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-a07231e6-d283-40fb-b49e-481d21a96934 tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:03:03.545533 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-a07231e6-d283-40fb-b49e-481d21a96934 tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:03:03.546762 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-a07231e6-d283-40fb-b49e-481d21a96934 tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:03:03.548791 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-a07231e6-d283-40fb-b49e-481d21a96934 tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:03:03.624990 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.quota [None req-a07231e6-d283-40fb-b49e-481d21a96934 tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] Getting quotas for project f46c6cdc3217456dba6eda8ff23e9f3a. Resources: {'ram', 'instances', 'cores'} {{(pid=117890) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 29 08:03:03.646542 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.quota [None req-a07231e6-d283-40fb-b49e-481d21a96934 tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] Getting quotas for user 0800a22846504b0d9c49e1520a69e45b and project f46c6cdc3217456dba6eda8ff23e9f3a. Resources: {'ram', 'instances', 'cores'} {{(pid=117890) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 29 08:03:03.703639 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-a07231e6-d283-40fb-b49e-481d21a96934 tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] Going to run 1 instances... {{(pid=117890) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 29 08:03:03.709845 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-a07231e6-d283-40fb-b49e-481d21a96934 tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] [instance: b4774888-237c-41c5-8c79-7a6e34d17d70] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5d2148a0-3628-4eff-88e9-5686abc0d33e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117890) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 29 08:03:03.900360 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-a07231e6-d283-40fb-b49e-481d21a96934 tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.580950 Jun 29 08:03:03.907798 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 2/4] 10.222.0.43 () {60 vars in 1146 bytes} [Wed Jun 29 08:03:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 3603 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 29 08:03:03.969130 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-280f7e8e-2204-41c2-b331-6fa1cfe07ec7 tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:03:03.970432 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-280f7e8e-2204-41c2-b331-6fa1cfe07ec7 tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] [instance: b4774888-237c-41c5-8c79-7a6e34d17d70] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:03:04.478825 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.virt.hardware [None req-32c770f9-182b-4d96-9373-2d047b455f5d tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Flavor limits 0:0:0 {{(pid=117889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 29 08:03:04.479644 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.virt.hardware [None req-32c770f9-182b-4d96-9373-2d047b455f5d tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Image limits 0:0:0 {{(pid=117889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 29 08:03:04.485445 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.virt.hardware [None req-32c770f9-182b-4d96-9373-2d047b455f5d tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Flavor pref 0:0:0 {{(pid=117889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 29 08:03:04.485445 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.virt.hardware [None req-32c770f9-182b-4d96-9373-2d047b455f5d tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Image pref 0:0:0 {{(pid=117889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 29 08:03:04.485445 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.virt.hardware [None req-32c770f9-182b-4d96-9373-2d047b455f5d tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 29 08:03:04.504496 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-32c770f9-182b-4d96-9373-2d047b455f5d tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:03:04.512694 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-32c770f9-182b-4d96-9373-2d047b455f5d tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:03:04.518427 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-32c770f9-182b-4d96-9373-2d047b455f5d tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:03:04.520801 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-32c770f9-182b-4d96-9373-2d047b455f5d tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:03:04.568290 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-280f7e8e-2204-41c2-b331-6fa1cfe07ec7 tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0800a22846504b0d9c49e1520a69e45b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46c6cdc3217456dba6eda8ff23e9f3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:03:04.605732 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-280f7e8e-2204-41c2-b331-6fa1cfe07ec7 tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] 10.222.0.43 "GET /compute/v2.1/servers/b4774888-237c-41c5-8c79-7a6e34d17d70" status: 200 len: 1214 microversion: 2.1 time: 0.686631 Jun 29 08:03:04.613279 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 3/5] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:03:03 2022] GET /compute/v2.1/servers/b4774888-237c-41c5-8c79-7a6e34d17d70 => generated 1214 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:03:04.671814 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.quota [None req-32c770f9-182b-4d96-9373-2d047b455f5d tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Getting quotas for project ab693125979f4bb7b7b3c94061610fe2. Resources: {'ram', 'instances', 'cores'} {{(pid=117889) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 29 08:03:04.703641 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.quota [None req-32c770f9-182b-4d96-9373-2d047b455f5d tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Getting quotas for user 1f4af4eedee24897be2e702ef51873b3 and project ab693125979f4bb7b7b3c94061610fe2. Resources: {'ram', 'instances', 'cores'} {{(pid=117889) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 29 08:03:04.793658 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-32c770f9-182b-4d96-9373-2d047b455f5d tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Going to run 1 instances... {{(pid=117889) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 29 08:03:04.824091 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-32c770f9-182b-4d96-9373-2d047b455f5d tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] [instance: 4f1bbb36-8695-4b09-9f25-bfc92ad06a86] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5d2148a0-3628-4eff-88e9-5686abc0d33e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117889) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 29 08:03:04.847526 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-6e8d3032-f2dc-4ce2-a1b2-e142bd40a20e tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Action: 'create', calling method: .version_select at 0x7f724294ff70>, body: {"keypair": {"name": "tempest-keypair-1205330371", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJSCe4m+FIqQeSv8nJwH9RM7evw4cfedkCUADU6e6vTMv/pesIgXgFlVwHYJYv+MxC1Km5iqjdL5PuJFxWQhIrrSEq7q0724/sHrGYdRc809ZamVh9BrzGNP4aC/9CbLUQ=="}} {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:03:04.960156 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.quota [None req-6e8d3032-f2dc-4ce2-a1b2-e142bd40a20e tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Getting quotas for project 4cd09897be9c4642b91dfb53a536e7d1. Resources: {'key_pairs'} {{(pid=117890) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 29 08:03:04.985833 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.quota [None req-6e8d3032-f2dc-4ce2-a1b2-e142bd40a20e tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Getting quotas for user c9065575ed314f6f8f3915bf596911e5 and project 4cd09897be9c4642b91dfb53a536e7d1. Resources: {'key_pairs'} {{(pid=117890) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 29 08:03:05.107402 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-6e8d3032-f2dc-4ce2-a1b2-e142bd40a20e tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.491997 Jun 29 08:03:05.108039 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 4/6] 10.222.0.43 () {62 vars in 1199 bytes} [Wed Jun 29 08:03:04 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 493 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 29 08:03:05.133965 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-32c770f9-182b-4d96-9373-2d047b455f5d tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.742950 Jun 29 08:03:05.134709 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 3/7] 10.222.0.43 () {60 vars in 1146 bytes} [Wed Jun 29 08:03:01 2022] POST /compute/v2.1/servers => generated 383 bytes in 3745 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 29 08:03:05.146652 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-f6d58a37-c343-40c7-8ab2-c75bfd640f0f tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:03:05.147048 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-f6d58a37-c343-40c7-8ab2-c75bfd640f0f tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] [instance: 4f1bbb36-8695-4b09-9f25-bfc92ad06a86] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:03:05.522298 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-f6d58a37-c343-40c7-8ab2-c75bfd640f0f tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4af4eedee24897be2e702ef51873b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab693125979f4bb7b7b3c94061610fe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:03:05.548733 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-f6d58a37-c343-40c7-8ab2-c75bfd640f0f tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] 10.222.0.43 "GET /compute/v2.1/servers/4f1bbb36-8695-4b09-9f25-bfc92ad06a86" status: 200 len: 1220 microversion: 2.1 time: 0.407193 Jun 29 08:03:05.553567 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 5/8] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:03:05 2022] GET /compute/v2.1/servers/4f1bbb36-8695-4b09-9f25-bfc92ad06a86 => generated 1220 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:03:05.643036 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-7d3ae64e-f579-4563-bc01-81988aa2992a tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:03:05.643697 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-7d3ae64e-f579-4563-bc01-81988aa2992a tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] [instance: b4774888-237c-41c5-8c79-7a6e34d17d70] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:03:06.569004 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-ee17744f-5609-4f9d-bb5a-8449d5dcd65a tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:03:06.569717 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-ee17744f-5609-4f9d-bb5a-8449d5dcd65a tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] [instance: 4f1bbb36-8695-4b09-9f25-bfc92ad06a86] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:03:06.607508 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-ee17744f-5609-4f9d-bb5a-8449d5dcd65a tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:03:06.607961 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-ee17744f-5609-4f9d-bb5a-8449d5dcd65a tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:03:06.619826 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-ee17744f-5609-4f9d-bb5a-8449d5dcd65a tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:03:06.620837 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-ee17744f-5609-4f9d-bb5a-8449d5dcd65a tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:03:06.712732 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-7d3ae64e-f579-4563-bc01-81988aa2992a tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0800a22846504b0d9c49e1520a69e45b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46c6cdc3217456dba6eda8ff23e9f3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:03:06.735213 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-7d3ae64e-f579-4563-bc01-81988aa2992a tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] 10.222.0.43 "GET /compute/v2.1/servers/b4774888-237c-41c5-8c79-7a6e34d17d70" status: 200 len: 1214 microversion: 2.1 time: 1.098626 Jun 29 08:03:06.735816 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 4/9] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:03:05 2022] GET /compute/v2.1/servers/b4774888-237c-41c5-8c79-7a6e34d17d70 => generated 1214 bytes in 1100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:03:07.479102 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-e437c4d2-b3e6-4823-b7ed-3b38063715cd tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-93138457", "imageRef": "5d2148a0-3628-4eff-88e9-5686abc0d33e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "83284d8b-f58e-483b-bfde-1c25f92d3de3"}], "security_groups": [{"name": "tempest-securitygroup--1288430290"}], "key_name": "tempest-keypair-1021976267", "user_data": "}} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:03:07.527728 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-ee17744f-5609-4f9d-bb5a-8449d5dcd65a tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4af4eedee24897be2e702ef51873b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab693125979f4bb7b7b3c94061610fe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:03:07.561501 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-ee17744f-5609-4f9d-bb5a-8449d5dcd65a tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] 10.222.0.43 "GET /compute/v2.1/servers/4f1bbb36-8695-4b09-9f25-bfc92ad06a86" status: 200 len: 1216 microversion: 2.1 time: 0.995583 Jun 29 08:03:07.564689 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 6/10] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:03:06 2022] GET /compute/v2.1/servers/4f1bbb36-8695-4b09-9f25-bfc92ad06a86 => generated 1216 bytes in 1002 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:03:07.780209 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-35ffde22-069e-404e-bc0a-d0197a538cea tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:03:07.791346 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-35ffde22-069e-404e-bc0a-d0197a538cea tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] [instance: b4774888-237c-41c5-8c79-7a6e34d17d70] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:03:07.862487 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-35ffde22-069e-404e-bc0a-d0197a538cea tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:03:07.869611 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-35ffde22-069e-404e-bc0a-d0197a538cea tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:03:07.878361 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-35ffde22-069e-404e-bc0a-d0197a538cea tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:03:07.889668 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-35ffde22-069e-404e-bc0a-d0197a538cea tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:03:07.928910 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.network.neutron [None req-e437c4d2-b3e6-4823-b7ed-3b38063715cd tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] validate_networks() for [('83284d8b-f58e-483b-bfde-1c25f92d3de3', None, None, None, None, None)] {{(pid=117889) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 29 08:03:08.544540 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-35ffde22-069e-404e-bc0a-d0197a538cea tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0800a22846504b0d9c49e1520a69e45b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46c6cdc3217456dba6eda8ff23e9f3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:03:08.576729 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-35ffde22-069e-404e-bc0a-d0197a538cea tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] 10.222.0.43 "GET /compute/v2.1/servers/b4774888-237c-41c5-8c79-7a6e34d17d70" status: 200 len: 1266 microversion: 2.1 time: 0.815655 Jun 29 08:03:08.594080 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 7/11] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:03:07 2022] GET /compute/v2.1/servers/b4774888-237c-41c5-8c79-7a6e34d17d70 => generated 1266 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:03:08.615461 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-9a8ad5fc-14b8-4034-976a-d056ed3f193d tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:03:08.615730 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-9a8ad5fc-14b8-4034-976a-d056ed3f193d tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] [instance: 4f1bbb36-8695-4b09-9f25-bfc92ad06a86] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:03:08.676554 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-9a8ad5fc-14b8-4034-976a-d056ed3f193d tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:03:08.677567 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-9a8ad5fc-14b8-4034-976a-d056ed3f193d tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:03:08.678441 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-9a8ad5fc-14b8-4034-976a-d056ed3f193d tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:03:08.678944 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-9a8ad5fc-14b8-4034-976a-d056ed3f193d tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:03:09.898285 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-9a8ad5fc-14b8-4034-976a-d056ed3f193d tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4af4eedee24897be2e702ef51873b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab693125979f4bb7b7b3c94061610fe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:03:09.936340 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-9a8ad5fc-14b8-4034-976a-d056ed3f193d tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] 10.222.0.43 "GET /compute/v2.1/servers/4f1bbb36-8695-4b09-9f25-bfc92ad06a86" status: 200 len: 1290 microversion: 2.1 time: 1.339804 Jun 29 08:03:09.947666 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 8/12] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:03:08 2022] GET /compute/v2.1/servers/4f1bbb36-8695-4b09-9f25-bfc92ad06a86 => generated 1290 bytes in 1352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:03:09.960223 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.virt.hardware [None req-e437c4d2-b3e6-4823-b7ed-3b38063715cd tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Flavor limits 0:0:0 {{(pid=117889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 29 08:03:09.961663 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.virt.hardware [None req-e437c4d2-b3e6-4823-b7ed-3b38063715cd tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Image limits 0:0:0 {{(pid=117889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 29 08:03:09.961895 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.virt.hardware [None req-e437c4d2-b3e6-4823-b7ed-3b38063715cd tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Flavor pref 0:0:0 {{(pid=117889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 29 08:03:09.962335 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.virt.hardware [None req-e437c4d2-b3e6-4823-b7ed-3b38063715cd tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Image pref 0:0:0 {{(pid=117889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 29 08:03:09.962761 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.virt.hardware [None req-e437c4d2-b3e6-4823-b7ed-3b38063715cd tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 29 08:03:09.979158 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-2dc6f963-f62b-41ea-ac75-66422622a354 tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:03:09.982904 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-2dc6f963-f62b-41ea-ac75-66422622a354 tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] [instance: b4774888-237c-41c5-8c79-7a6e34d17d70] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:03:09.987865 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e437c4d2-b3e6-4823-b7ed-3b38063715cd tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:03:09.988264 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e437c4d2-b3e6-4823-b7ed-3b38063715cd tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:03:09.989010 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e437c4d2-b3e6-4823-b7ed-3b38063715cd tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:03:09.989468 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e437c4d2-b3e6-4823-b7ed-3b38063715cd tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:03:10.011289 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-2dc6f963-f62b-41ea-ac75-66422622a354 tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:03:10.012050 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-2dc6f963-f62b-41ea-ac75-66422622a354 tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:03:10.014002 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-2dc6f963-f62b-41ea-ac75-66422622a354 tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:03:10.015097 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-2dc6f963-f62b-41ea-ac75-66422622a354 tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:03:10.052941 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.quota [None req-e437c4d2-b3e6-4823-b7ed-3b38063715cd tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Getting quotas for project 5e0c37d941434569b3dbd07e22125210. Resources: {'ram', 'instances', 'cores'} {{(pid=117889) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 29 08:03:10.061567 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.quota [None req-e437c4d2-b3e6-4823-b7ed-3b38063715cd tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Getting quotas for user c70c44993ab240b1a5231df4c9d550c9 and project 5e0c37d941434569b3dbd07e22125210. Resources: {'ram', 'instances', 'cores'} {{(pid=117889) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 29 08:03:10.092226 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-e437c4d2-b3e6-4823-b7ed-3b38063715cd tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Going to run 1 instances... {{(pid=117889) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 29 08:03:10.099692 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-e437c4d2-b3e6-4823-b7ed-3b38063715cd tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] [instance: d5d97f9b-3f4a-4a5e-89e8-98d55412fe71] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5d2148a0-3628-4eff-88e9-5686abc0d33e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117889) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 29 08:03:10.170528 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-e437c4d2-b3e6-4823-b7ed-3b38063715cd tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.705012 Jun 29 08:03:10.172200 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 5/13] 10.222.0.43 () {60 vars in 1146 bytes} [Wed Jun 29 08:03:07 2022] POST /compute/v2.1/servers => generated 402 bytes in 2707 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 29 08:03:10.184209 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-ce98877c-fcfe-4e38-9aa4-9a176380a71f tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:03:10.185597 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-ce98877c-fcfe-4e38-9aa4-9a176380a71f tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] [instance: d5d97f9b-3f4a-4a5e-89e8-98d55412fe71] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:03:10.579315 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-ce98877c-fcfe-4e38-9aa4-9a176380a71f tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c70c44993ab240b1a5231df4c9d550c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e0c37d941434569b3dbd07e22125210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:03:10.593965 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-ce98877c-fcfe-4e38-9aa4-9a176380a71f tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] 10.222.0.43 "GET /compute/v2.1/servers/d5d97f9b-3f4a-4a5e-89e8-98d55412fe71" status: 200 len: 1236 microversion: 2.1 time: 0.412420 Jun 29 08:03:10.594737 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 6/14] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:03:10 2022] GET /compute/v2.1/servers/d5d97f9b-3f4a-4a5e-89e8-98d55412fe71 => generated 1236 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 08:03:10.975643 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-9d84bba6-43ca-4df0-83e7-a0679db6576c tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:03:10.978278 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-9d84bba6-43ca-4df0-83e7-a0679db6576c tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] [instance: 4f1bbb36-8695-4b09-9f25-bfc92ad06a86] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:03:11.019424 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-9d84bba6-43ca-4df0-83e7-a0679db6576c tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:03:11.021171 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-9d84bba6-43ca-4df0-83e7-a0679db6576c tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:03:11.024543 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-9d84bba6-43ca-4df0-83e7-a0679db6576c tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:03:11.028877 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-9d84bba6-43ca-4df0-83e7-a0679db6576c tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:03:11.666352 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-9d84bba6-43ca-4df0-83e7-a0679db6576c tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4af4eedee24897be2e702ef51873b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab693125979f4bb7b7b3c94061610fe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:03:11.722068 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-9d84bba6-43ca-4df0-83e7-a0679db6576c tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] 10.222.0.43 "GET /compute/v2.1/servers/4f1bbb36-8695-4b09-9f25-bfc92ad06a86" status: 200 len: 1278 microversion: 2.1 time: 0.754860 Jun 29 08:03:11.723049 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 7/15] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:03:10 2022] GET /compute/v2.1/servers/4f1bbb36-8695-4b09-9f25-bfc92ad06a86 => generated 1278 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:03:11.734524 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-643fbefc-3d5a-41ec-9169-0f419d4839bc tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:03:11.735151 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-643fbefc-3d5a-41ec-9169-0f419d4839bc tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] [instance: d5d97f9b-3f4a-4a5e-89e8-98d55412fe71] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:03:11.990384 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-643fbefc-3d5a-41ec-9169-0f419d4839bc tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c70c44993ab240b1a5231df4c9d550c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e0c37d941434569b3dbd07e22125210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:03:12.045282 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-643fbefc-3d5a-41ec-9169-0f419d4839bc tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] 10.222.0.43 "GET /compute/v2.1/servers/d5d97f9b-3f4a-4a5e-89e8-98d55412fe71" status: 200 len: 1236 microversion: 2.1 time: 0.320867 Jun 29 08:03:12.061744 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 8/16] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:03:11 2022] GET /compute/v2.1/servers/d5d97f9b-3f4a-4a5e-89e8-98d55412fe71 => generated 1236 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:03:12.748797 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-6c96569e-1e5c-4149-9f0f-e513eeb8db99 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:03:12.754075 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-6c96569e-1e5c-4149-9f0f-e513eeb8db99 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] [instance: 4f1bbb36-8695-4b09-9f25-bfc92ad06a86] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:03:12.805347 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-6c96569e-1e5c-4149-9f0f-e513eeb8db99 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:03:12.812614 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-6c96569e-1e5c-4149-9f0f-e513eeb8db99 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:03:12.812614 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-6c96569e-1e5c-4149-9f0f-e513eeb8db99 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:03:12.812614 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-6c96569e-1e5c-4149-9f0f-e513eeb8db99 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:03:12.907409 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-2dc6f963-f62b-41ea-ac75-66422622a354 tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0800a22846504b0d9c49e1520a69e45b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46c6cdc3217456dba6eda8ff23e9f3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:03:12.937972 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-2dc6f963-f62b-41ea-ac75-66422622a354 tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] 10.222.0.43 "GET /compute/v2.1/servers/b4774888-237c-41c5-8c79-7a6e34d17d70" status: 200 len: 1272 microversion: 2.1 time: 2.971640 Jun 29 08:03:12.939041 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 9/17] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:03:09 2022] GET /compute/v2.1/servers/b4774888-237c-41c5-8c79-7a6e34d17d70 => generated 1272 bytes in 2977 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:03:13.095294 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-65d98241-9a28-419d-ab0d-ee13564bb77b tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:03:13.095294 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-65d98241-9a28-419d-ab0d-ee13564bb77b tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] [instance: d5d97f9b-3f4a-4a5e-89e8-98d55412fe71] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:03:13.106725 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-65d98241-9a28-419d-ab0d-ee13564bb77b tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:03:13.108399 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-65d98241-9a28-419d-ab0d-ee13564bb77b tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:03:13.110608 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-65d98241-9a28-419d-ab0d-ee13564bb77b tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:03:13.111146 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-65d98241-9a28-419d-ab0d-ee13564bb77b tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:03:13.142685 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-6c96569e-1e5c-4149-9f0f-e513eeb8db99 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4af4eedee24897be2e702ef51873b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab693125979f4bb7b7b3c94061610fe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:03:13.194547 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-6c96569e-1e5c-4149-9f0f-e513eeb8db99 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] 10.222.0.43 "GET /compute/v2.1/servers/4f1bbb36-8695-4b09-9f25-bfc92ad06a86" status: 200 len: 1278 microversion: 2.1 time: 0.431144 Jun 29 08:03:13.199129 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 9/18] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:03:12 2022] GET /compute/v2.1/servers/4f1bbb36-8695-4b09-9f25-bfc92ad06a86 => generated 1278 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:03:13.578710 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG dbcounter [-] [117890] Writing DB stats nova_cell0:SELECT=4 {{(pid=117890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:03:13.972112 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-b2a646ff-7576-46dd-98f9-a483f2815ee7 tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:03:13.973927 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-b2a646ff-7576-46dd-98f9-a483f2815ee7 tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] [instance: b4774888-237c-41c5-8c79-7a6e34d17d70] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:03:13.991534 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-b2a646ff-7576-46dd-98f9-a483f2815ee7 tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:03:13.996611 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-b2a646ff-7576-46dd-98f9-a483f2815ee7 tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:03:14.000123 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-b2a646ff-7576-46dd-98f9-a483f2815ee7 tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:03:14.003715 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-b2a646ff-7576-46dd-98f9-a483f2815ee7 tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:03:14.140737 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-65d98241-9a28-419d-ab0d-ee13564bb77b tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c70c44993ab240b1a5231df4c9d550c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e0c37d941434569b3dbd07e22125210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:03:14.178423 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-65d98241-9a28-419d-ab0d-ee13564bb77b tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] 10.222.0.43 "GET /compute/v2.1/servers/d5d97f9b-3f4a-4a5e-89e8-98d55412fe71" status: 200 len: 1288 microversion: 2.1 time: 1.101192 Jun 29 08:03:14.196494 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 10/19] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:03:13 2022] GET /compute/v2.1/servers/d5d97f9b-3f4a-4a5e-89e8-98d55412fe71 => generated 1288 bytes in 1121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:03:14.231890 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-399f0d7c-f6b4-4216-969c-4bab76138168 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:03:14.231890 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-399f0d7c-f6b4-4216-969c-4bab76138168 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] [instance: 4f1bbb36-8695-4b09-9f25-bfc92ad06a86] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:03:14.254868 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-399f0d7c-f6b4-4216-969c-4bab76138168 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:03:14.255222 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-399f0d7c-f6b4-4216-969c-4bab76138168 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:03:14.268421 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-399f0d7c-f6b4-4216-969c-4bab76138168 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:03:14.270151 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-399f0d7c-f6b4-4216-969c-4bab76138168 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:03:14.973590 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-b2a646ff-7576-46dd-98f9-a483f2815ee7 tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0800a22846504b0d9c49e1520a69e45b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46c6cdc3217456dba6eda8ff23e9f3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:03:14.987528 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-b2a646ff-7576-46dd-98f9-a483f2815ee7 tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] 10.222.0.43 "GET /compute/v2.1/servers/b4774888-237c-41c5-8c79-7a6e34d17d70" status: 200 len: 1272 microversion: 2.1 time: 1.022262 Jun 29 08:03:14.998331 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 10/20] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:03:13 2022] GET /compute/v2.1/servers/b4774888-237c-41c5-8c79-7a6e34d17d70 => generated 1272 bytes in 1031 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:03:15.216764 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-fd02799b-2f00-4d7c-8413-1b78c5aab45d tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:03:15.217421 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-fd02799b-2f00-4d7c-8413-1b78c5aab45d tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] [instance: d5d97f9b-3f4a-4a5e-89e8-98d55412fe71] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:03:15.268323 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-fd02799b-2f00-4d7c-8413-1b78c5aab45d tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:03:15.272809 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-fd02799b-2f00-4d7c-8413-1b78c5aab45d tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:03:15.274330 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-fd02799b-2f00-4d7c-8413-1b78c5aab45d tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:03:15.278205 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-fd02799b-2f00-4d7c-8413-1b78c5aab45d tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:03:15.349963 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-399f0d7c-f6b4-4216-969c-4bab76138168 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4af4eedee24897be2e702ef51873b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab693125979f4bb7b7b3c94061610fe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:03:15.372935 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-399f0d7c-f6b4-4216-969c-4bab76138168 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] 10.222.0.43 "GET /compute/v2.1/servers/4f1bbb36-8695-4b09-9f25-bfc92ad06a86" status: 200 len: 1278 microversion: 2.1 time: 1.149799 Jun 29 08:03:15.377235 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 11/21] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:03:14 2022] GET /compute/v2.1/servers/4f1bbb36-8695-4b09-9f25-bfc92ad06a86 => generated 1278 bytes in 1155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:03:16.002525 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG dbcounter [-] [117890] Writing DB stats nova_cell0:SELECT=20 {{(pid=117890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:03:16.008960 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-579c3ba2-ae6f-421b-9663-fe8095dd2eca tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:03:16.011034 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-579c3ba2-ae6f-421b-9663-fe8095dd2eca tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] [instance: b4774888-237c-41c5-8c79-7a6e34d17d70] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:03:16.040585 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-579c3ba2-ae6f-421b-9663-fe8095dd2eca tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:03:16.046051 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-579c3ba2-ae6f-421b-9663-fe8095dd2eca tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:03:16.047303 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-579c3ba2-ae6f-421b-9663-fe8095dd2eca tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:03:16.052217 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-579c3ba2-ae6f-421b-9663-fe8095dd2eca tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:03:16.410892 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-579c3ba2-ae6f-421b-9663-fe8095dd2eca tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0800a22846504b0d9c49e1520a69e45b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46c6cdc3217456dba6eda8ff23e9f3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:03:16.445672 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-579c3ba2-ae6f-421b-9663-fe8095dd2eca tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] 10.222.0.43 "GET /compute/v2.1/servers/b4774888-237c-41c5-8c79-7a6e34d17d70" status: 200 len: 1272 microversion: 2.1 time: 0.440748 Jun 29 08:03:16.447386 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 12/22] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:03:16 2022] GET /compute/v2.1/servers/b4774888-237c-41c5-8c79-7a6e34d17d70 => generated 1272 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:03:16.470754 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-4a0fb341-e648-4fc0-8549-efb251092126 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:03:16.477969 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-4a0fb341-e648-4fc0-8549-efb251092126 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] [instance: 4f1bbb36-8695-4b09-9f25-bfc92ad06a86] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:03:16.505897 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-4a0fb341-e648-4fc0-8549-efb251092126 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:03:16.506567 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-4a0fb341-e648-4fc0-8549-efb251092126 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:03:16.508511 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-4a0fb341-e648-4fc0-8549-efb251092126 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:03:16.509325 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-4a0fb341-e648-4fc0-8549-efb251092126 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:03:16.663629 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-fd02799b-2f00-4d7c-8413-1b78c5aab45d tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c70c44993ab240b1a5231df4c9d550c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e0c37d941434569b3dbd07e22125210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:03:16.700105 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-fd02799b-2f00-4d7c-8413-1b78c5aab45d tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] 10.222.0.43 "GET /compute/v2.1/servers/d5d97f9b-3f4a-4a5e-89e8-98d55412fe71" status: 200 len: 1294 microversion: 2.1 time: 1.487255 Jun 29 08:03:16.701218 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 11/23] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:03:15 2022] GET /compute/v2.1/servers/d5d97f9b-3f4a-4a5e-89e8-98d55412fe71 => generated 1294 bytes in 1490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:03:16.871991 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-4a0fb341-e648-4fc0-8549-efb251092126 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4af4eedee24897be2e702ef51873b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab693125979f4bb7b7b3c94061610fe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:03:16.890193 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-4a0fb341-e648-4fc0-8549-efb251092126 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] 10.222.0.43 "GET /compute/v2.1/servers/4f1bbb36-8695-4b09-9f25-bfc92ad06a86" status: 200 len: 1278 microversion: 2.1 time: 0.440545 Jun 29 08:03:16.902757 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 13/24] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:03:16 2022] GET /compute/v2.1/servers/4f1bbb36-8695-4b09-9f25-bfc92ad06a86 => generated 1278 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:03:17.511266 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-b8163250-b951-4b1a-bed8-3430c31dc502 tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:03:17.512566 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-b8163250-b951-4b1a-bed8-3430c31dc502 tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] [instance: b4774888-237c-41c5-8c79-7a6e34d17d70] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:03:17.564184 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-b8163250-b951-4b1a-bed8-3430c31dc502 tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:03:17.565749 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-b8163250-b951-4b1a-bed8-3430c31dc502 tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:03:17.577932 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-b8163250-b951-4b1a-bed8-3430c31dc502 tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:03:17.578743 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-b8163250-b951-4b1a-bed8-3430c31dc502 tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:03:17.721918 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-133cae56-de43-4fe5-864a-7a40d6960f5c tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:03:17.722731 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-133cae56-de43-4fe5-864a-7a40d6960f5c tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] [instance: d5d97f9b-3f4a-4a5e-89e8-98d55412fe71] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:03:17.747589 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-133cae56-de43-4fe5-864a-7a40d6960f5c tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:03:17.751442 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-133cae56-de43-4fe5-864a-7a40d6960f5c tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:03:17.759505 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-133cae56-de43-4fe5-864a-7a40d6960f5c tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:03:17.762229 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-133cae56-de43-4fe5-864a-7a40d6960f5c tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:03:17.972328 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-b8163250-b951-4b1a-bed8-3430c31dc502 tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0800a22846504b0d9c49e1520a69e45b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46c6cdc3217456dba6eda8ff23e9f3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:03:18.001270 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-b8163250-b951-4b1a-bed8-3430c31dc502 tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] 10.222.0.43 "GET /compute/v2.1/servers/b4774888-237c-41c5-8c79-7a6e34d17d70" status: 200 len: 1272 microversion: 2.1 time: 0.540589 Jun 29 08:03:18.013966 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 12/25] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:03:17 2022] GET /compute/v2.1/servers/b4774888-237c-41c5-8c79-7a6e34d17d70 => generated 1272 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:03:18.030734 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-9e2c9dfa-ca0e-47cb-8906-a8dbb8211039 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:03:18.034071 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-9e2c9dfa-ca0e-47cb-8906-a8dbb8211039 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] [instance: 4f1bbb36-8695-4b09-9f25-bfc92ad06a86] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:03:18.076393 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-9e2c9dfa-ca0e-47cb-8906-a8dbb8211039 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:03:18.077485 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-9e2c9dfa-ca0e-47cb-8906-a8dbb8211039 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:03:18.086695 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-9e2c9dfa-ca0e-47cb-8906-a8dbb8211039 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:03:18.093944 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-9e2c9dfa-ca0e-47cb-8906-a8dbb8211039 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:03:18.959899 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-9e2c9dfa-ca0e-47cb-8906-a8dbb8211039 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4af4eedee24897be2e702ef51873b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab693125979f4bb7b7b3c94061610fe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:03:18.971127 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-9e2c9dfa-ca0e-47cb-8906-a8dbb8211039 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] 10.222.0.43 "GET /compute/v2.1/servers/4f1bbb36-8695-4b09-9f25-bfc92ad06a86" status: 200 len: 1278 microversion: 2.1 time: 0.954553 Jun 29 08:03:18.979705 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 13/26] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:03:18 2022] GET /compute/v2.1/servers/4f1bbb36-8695-4b09-9f25-bfc92ad06a86 => generated 1278 bytes in 964 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:03:19.048560 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-44ff4f85-4900-4294-bf4f-84ebd80f40ad tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:03:19.048560 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-44ff4f85-4900-4294-bf4f-84ebd80f40ad tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] [instance: b4774888-237c-41c5-8c79-7a6e34d17d70] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:03:19.064453 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-44ff4f85-4900-4294-bf4f-84ebd80f40ad tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:03:19.065259 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-44ff4f85-4900-4294-bf4f-84ebd80f40ad tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:03:19.066651 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-44ff4f85-4900-4294-bf4f-84ebd80f40ad tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:03:19.067422 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-44ff4f85-4900-4294-bf4f-84ebd80f40ad tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:03:19.637123 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-44ff4f85-4900-4294-bf4f-84ebd80f40ad tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0800a22846504b0d9c49e1520a69e45b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46c6cdc3217456dba6eda8ff23e9f3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:03:19.654985 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-44ff4f85-4900-4294-bf4f-84ebd80f40ad tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] 10.222.0.43 "GET /compute/v2.1/servers/b4774888-237c-41c5-8c79-7a6e34d17d70" status: 200 len: 1272 microversion: 2.1 time: 0.614687 Jun 29 08:03:19.655527 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 14/27] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:03:19 2022] GET /compute/v2.1/servers/b4774888-237c-41c5-8c79-7a6e34d17d70 => generated 1272 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 08:03:19.899452 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-133cae56-de43-4fe5-864a-7a40d6960f5c tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c70c44993ab240b1a5231df4c9d550c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e0c37d941434569b3dbd07e22125210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:03:19.966322 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-133cae56-de43-4fe5-864a-7a40d6960f5c tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] 10.222.0.43 "GET /compute/v2.1/servers/d5d97f9b-3f4a-4a5e-89e8-98d55412fe71" status: 200 len: 1294 microversion: 2.1 time: 2.247239 Jun 29 08:03:19.967699 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 14/28] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:03:17 2022] GET /compute/v2.1/servers/d5d97f9b-3f4a-4a5e-89e8-98d55412fe71 => generated 1294 bytes in 2253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:03:20.015564 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-5141f9ee-3fc1-4c7e-aefd-0a57832fbef9 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:03:20.016860 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-5141f9ee-3fc1-4c7e-aefd-0a57832fbef9 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] [instance: 4f1bbb36-8695-4b09-9f25-bfc92ad06a86] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:03:20.019515 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_cell0:SELECT=4 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:03:20.037889 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-5141f9ee-3fc1-4c7e-aefd-0a57832fbef9 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:03:20.039802 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-5141f9ee-3fc1-4c7e-aefd-0a57832fbef9 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:03:20.048371 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-5141f9ee-3fc1-4c7e-aefd-0a57832fbef9 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:03:20.052230 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-5141f9ee-3fc1-4c7e-aefd-0a57832fbef9 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:03:20.688365 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-387eecef-146b-4c02-83a9-0dd8b3c333ce tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:03:20.689496 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-387eecef-146b-4c02-83a9-0dd8b3c333ce tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] [instance: b4774888-237c-41c5-8c79-7a6e34d17d70] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:03:20.705867 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-387eecef-146b-4c02-83a9-0dd8b3c333ce tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:03:20.706596 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-387eecef-146b-4c02-83a9-0dd8b3c333ce tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:03:20.707559 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-387eecef-146b-4c02-83a9-0dd8b3c333ce tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:03:20.708149 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-387eecef-146b-4c02-83a9-0dd8b3c333ce tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:03:21.302694 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-5141f9ee-3fc1-4c7e-aefd-0a57832fbef9 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4af4eedee24897be2e702ef51873b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab693125979f4bb7b7b3c94061610fe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:03:21.321876 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-5141f9ee-3fc1-4c7e-aefd-0a57832fbef9 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] 10.222.0.43 "GET /compute/v2.1/servers/4f1bbb36-8695-4b09-9f25-bfc92ad06a86" status: 200 len: 1320 microversion: 2.1 time: 1.309838 Jun 29 08:03:21.349188 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 15/29] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:03:20 2022] GET /compute/v2.1/servers/4f1bbb36-8695-4b09-9f25-bfc92ad06a86 => generated 1320 bytes in 1338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 08:03:21.358859 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-0e322fb9-f639-497f-8ca7-9bc1e69a7921 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:03:21.364416 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-0e322fb9-f639-497f-8ca7-9bc1e69a7921 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] [instance: d5d97f9b-3f4a-4a5e-89e8-98d55412fe71] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:03:21.381989 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-0e322fb9-f639-497f-8ca7-9bc1e69a7921 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:03:21.385278 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-0e322fb9-f639-497f-8ca7-9bc1e69a7921 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:03:21.386381 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-0e322fb9-f639-497f-8ca7-9bc1e69a7921 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:03:21.388805 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-0e322fb9-f639-497f-8ca7-9bc1e69a7921 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:03:22.039330 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_cell0:SELECT=24 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:03:22.139807 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-387eecef-146b-4c02-83a9-0dd8b3c333ce tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0800a22846504b0d9c49e1520a69e45b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46c6cdc3217456dba6eda8ff23e9f3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:03:22.150628 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG dbcounter [-] [117890] Writing DB stats nova_cell1:SELECT=63 {{(pid=117890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:03:22.159987 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-387eecef-146b-4c02-83a9-0dd8b3c333ce tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] 10.222.0.43 "GET /compute/v2.1/servers/b4774888-237c-41c5-8c79-7a6e34d17d70" status: 200 len: 1314 microversion: 2.1 time: 1.476206 Jun 29 08:03:22.161389 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 15/30] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:03:20 2022] GET /compute/v2.1/servers/b4774888-237c-41c5-8c79-7a6e34d17d70 => generated 1314 bytes in 1478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 08:03:22.250565 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-0e322fb9-f639-497f-8ca7-9bc1e69a7921 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c70c44993ab240b1a5231df4c9d550c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e0c37d941434569b3dbd07e22125210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:03:22.307538 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-0e322fb9-f639-497f-8ca7-9bc1e69a7921 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] 10.222.0.43 "GET /compute/v2.1/servers/d5d97f9b-3f4a-4a5e-89e8-98d55412fe71" status: 200 len: 1362 microversion: 2.1 time: 0.955625 Jun 29 08:03:22.308584 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 16/31] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:03:21 2022] GET /compute/v2.1/servers/d5d97f9b-3f4a-4a5e-89e8-98d55412fe71 => generated 1362 bytes in 958 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:03:22.350800 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-04078d9b-c2d1-4a9c-9785-4aa7b00c5ed7 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:03:22.352403 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-04078d9b-c2d1-4a9c-9785-4aa7b00c5ed7 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] [instance: 4f1bbb36-8695-4b09-9f25-bfc92ad06a86] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:03:22.354906 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG dbcounter [-] [117890] Writing DB stats nova_api:SELECT=66,nova_api:INSERT=7 {{(pid=117890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:03:22.374087 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-04078d9b-c2d1-4a9c-9785-4aa7b00c5ed7 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:03:22.374848 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-04078d9b-c2d1-4a9c-9785-4aa7b00c5ed7 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:03:22.416850 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-04078d9b-c2d1-4a9c-9785-4aa7b00c5ed7 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:03:22.417693 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-04078d9b-c2d1-4a9c-9785-4aa7b00c5ed7 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:03:22.584027 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-fb00fe42-b57d-41df-99f4-2839f83a4704 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1300788491", "imageRef": "5d2148a0-3628-4eff-88e9-5686abc0d33e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2f3afbc5-288f-4461-967f-3d79e5607ae1"}], "security_groups": [{"name": "tempest-securitygroup--1304169914"}], "key_name": "tempest-keypair-1205330371", "user_data": "}} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:03:23.016766 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.network.neutron [None req-fb00fe42-b57d-41df-99f4-2839f83a4704 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] validate_networks() for [('2f3afbc5-288f-4461-967f-3d79e5607ae1', None, None, None, None, None)] {{(pid=117889) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 29 08:03:23.937434 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-04078d9b-c2d1-4a9c-9785-4aa7b00c5ed7 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4af4eedee24897be2e702ef51873b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab693125979f4bb7b7b3c94061610fe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:03:23.987755 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-04078d9b-c2d1-4a9c-9785-4aa7b00c5ed7 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] 10.222.0.43 "GET /compute/v2.1/servers/4f1bbb36-8695-4b09-9f25-bfc92ad06a86" status: 200 len: 1320 microversion: 2.1 time: 1.638158 Jun 29 08:03:23.993723 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 16/32] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:03:22 2022] GET /compute/v2.1/servers/4f1bbb36-8695-4b09-9f25-bfc92ad06a86 => generated 1320 bytes in 1647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:03:24.023555 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-30a95f42-18fd-439f-863f-1bfe0ffc21c1 tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:03:24.026165 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-30a95f42-18fd-439f-863f-1bfe0ffc21c1 tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] [instance: b4774888-237c-41c5-8c79-7a6e34d17d70] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:03:24.056966 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-30a95f42-18fd-439f-863f-1bfe0ffc21c1 tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:03:24.059636 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-30a95f42-18fd-439f-863f-1bfe0ffc21c1 tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:03:24.064285 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-30a95f42-18fd-439f-863f-1bfe0ffc21c1 tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:03:24.093260 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-30a95f42-18fd-439f-863f-1bfe0ffc21c1 tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:03:24.968341 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-30a95f42-18fd-439f-863f-1bfe0ffc21c1 tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0800a22846504b0d9c49e1520a69e45b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46c6cdc3217456dba6eda8ff23e9f3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:03:24.998233 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-30a95f42-18fd-439f-863f-1bfe0ffc21c1 tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] 10.222.0.43 "GET /compute/v2.1/servers/b4774888-237c-41c5-8c79-7a6e34d17d70" status: 200 len: 1314 microversion: 2.1 time: 1.001418 Jun 29 08:03:25.007018 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 17/33] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:03:23 2022] GET /compute/v2.1/servers/b4774888-237c-41c5-8c79-7a6e34d17d70 => generated 1314 bytes in 1012 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:03:25.019962 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-ee923dcf-0ab8-40b9-966f-f98e232a13c6 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:03:25.021666 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-ee923dcf-0ab8-40b9-966f-f98e232a13c6 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] [instance: d5d97f9b-3f4a-4a5e-89e8-98d55412fe71] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:03:25.039716 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-ee923dcf-0ab8-40b9-966f-f98e232a13c6 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:03:25.042269 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-ee923dcf-0ab8-40b9-966f-f98e232a13c6 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:03:25.044854 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-ee923dcf-0ab8-40b9-966f-f98e232a13c6 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:03:25.047872 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-ee923dcf-0ab8-40b9-966f-f98e232a13c6 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:03:25.815806 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-ee923dcf-0ab8-40b9-966f-f98e232a13c6 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c70c44993ab240b1a5231df4c9d550c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e0c37d941434569b3dbd07e22125210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:03:25.829366 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-ee923dcf-0ab8-40b9-966f-f98e232a13c6 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] 10.222.0.43 "GET /compute/v2.1/servers/d5d97f9b-3f4a-4a5e-89e8-98d55412fe71" status: 200 len: 1362 microversion: 2.1 time: 0.820133 Jun 29 08:03:25.831591 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 18/34] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:03:25 2022] GET /compute/v2.1/servers/d5d97f9b-3f4a-4a5e-89e8-98d55412fe71 => generated 1362 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:03:26.493123 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [req-7a6b4bac-f676-48b6-aea6-642449fd20f7 req-70643211-4cbd-402c-bbb1-3ca279afdcb8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "79765057-c430-4292-bc5f-ee0c6a66b367", "tag": "fcb56668-c13f-4fb2-83eb-845e29b080ce"}]} {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:03:26.522161 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [req-7a6b4bac-f676-48b6-aea6-642449fd20f7 req-70643211-4cbd-402c-bbb1-3ca279afdcb8 service nova] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:03:26.525125 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [req-7a6b4bac-f676-48b6-aea6-642449fd20f7 req-70643211-4cbd-402c-bbb1-3ca279afdcb8 service nova] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:03:26.642189 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.compute.server_external_events [req-7a6b4bac-f676-48b6-aea6-642449fd20f7 req-70643211-4cbd-402c-bbb1-3ca279afdcb8 service nova] Creating event network-changed:fcb56668-c13f-4fb2-83eb-845e29b080ce for instance 79765057-c430-4292-bc5f-ee0c6a66b367 on hv-cinder-76810 Jun 29 08:03:26.646830 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [req-7a6b4bac-f676-48b6-aea6-642449fd20f7 req-70643211-4cbd-402c-bbb1-3ca279afdcb8 service nova] Acquired lock "compute-rpcapi-router" {{(pid=117890) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 29 08:03:26.649102 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-7a67b83f-8879-4371-942a-16d890dd152e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:03:26.649829 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-7a67b83f-8879-4371-942a-16d890dd152e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:03:26.651010 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-7a67b83f-8879-4371-942a-16d890dd152e None None] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:03:26.652032 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-7a67b83f-8879-4371-942a-16d890dd152e None None] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:03:26.667321 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.compute.rpcapi [None req-7a67b83f-8879-4371-942a-16d890dd152e None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 29 08:03:26.668672 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-7a67b83f-8879-4371-942a-16d890dd152e None None] Releasing lock "compute-rpcapi-router" {{(pid=117890) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 29 08:03:26.736811 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-7a67b83f-8879-4371-942a-16d890dd152e None None] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.903383 Jun 29 08:03:26.738070 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 19/35] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jun 29 08:03:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:03:26.754038 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-ee0ab249-7154-43b1-b700-5d303611841c tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:03:26.771344 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-ee0ab249-7154-43b1-b700-5d303611841c tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] [instance: 4f1bbb36-8695-4b09-9f25-bfc92ad06a86] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:03:26.822782 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-ee0ab249-7154-43b1-b700-5d303611841c tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:03:26.836510 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-ee0ab249-7154-43b1-b700-5d303611841c tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:03:26.841124 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-ee0ab249-7154-43b1-b700-5d303611841c tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:03:26.845505 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-ee0ab249-7154-43b1-b700-5d303611841c tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:03:26.998517 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.virt.hardware [None req-fb00fe42-b57d-41df-99f4-2839f83a4704 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Flavor limits 0:0:0 {{(pid=117889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 29 08:03:26.999766 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.virt.hardware [None req-fb00fe42-b57d-41df-99f4-2839f83a4704 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Image limits 0:0:0 {{(pid=117889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 29 08:03:27.001246 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.virt.hardware [None req-fb00fe42-b57d-41df-99f4-2839f83a4704 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Flavor pref 0:0:0 {{(pid=117889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 29 08:03:27.002689 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.virt.hardware [None req-fb00fe42-b57d-41df-99f4-2839f83a4704 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Image pref 0:0:0 {{(pid=117889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 29 08:03:27.003584 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.virt.hardware [None req-fb00fe42-b57d-41df-99f4-2839f83a4704 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 29 08:03:27.076876 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-fb00fe42-b57d-41df-99f4-2839f83a4704 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:03:27.079669 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-fb00fe42-b57d-41df-99f4-2839f83a4704 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:03:27.081744 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-fb00fe42-b57d-41df-99f4-2839f83a4704 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:03:27.083297 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-fb00fe42-b57d-41df-99f4-2839f83a4704 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:03:27.206173 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.quota [None req-fb00fe42-b57d-41df-99f4-2839f83a4704 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Getting quotas for project 4cd09897be9c4642b91dfb53a536e7d1. Resources: {'ram', 'instances', 'cores'} {{(pid=117889) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 29 08:03:27.230078 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.quota [None req-fb00fe42-b57d-41df-99f4-2839f83a4704 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Getting quotas for user c9065575ed314f6f8f3915bf596911e5 and project 4cd09897be9c4642b91dfb53a536e7d1. Resources: {'ram', 'instances', 'cores'} {{(pid=117889) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 29 08:03:27.296408 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-fb00fe42-b57d-41df-99f4-2839f83a4704 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Going to run 1 instances... {{(pid=117889) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 29 08:03:27.309086 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-fb00fe42-b57d-41df-99f4-2839f83a4704 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] [instance: f99567d1-cadf-40c5-b1dc-f86739b2b16c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5d2148a0-3628-4eff-88e9-5686abc0d33e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117889) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 29 08:03:27.442871 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-fb00fe42-b57d-41df-99f4-2839f83a4704 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 4.861367 Jun 29 08:03:27.450048 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 17/36] 10.222.0.43 () {62 vars in 1187 bytes} [Wed Jun 29 08:03:22 2022] POST /compute/v2.1/servers => generated 402 bytes in 4871 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Jun 29 08:03:28.339182 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [req-255a8ef5-eafb-40cb-829e-d00ad3ced8a6 req-63db04f3-fe99-470e-a1e4-d0eb6d830d12 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4f1bbb36-8695-4b09-9f25-bfc92ad06a86", "tag": "e221748f-d034-48b4-8150-5e3a269027a4"}]} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:03:28.422186 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=10 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:03:28.430606 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-255a8ef5-eafb-40cb-829e-d00ad3ced8a6 req-63db04f3-fe99-470e-a1e4-d0eb6d830d12 service nova] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:03:28.446170 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-255a8ef5-eafb-40cb-829e-d00ad3ced8a6 req-63db04f3-fe99-470e-a1e4-d0eb6d830d12 service nova] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:03:28.556858 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-ee0ab249-7154-43b1-b700-5d303611841c tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4af4eedee24897be2e702ef51873b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab693125979f4bb7b7b3c94061610fe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:03:28.566333 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_cell1:SELECT=61 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:03:28.588777 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.compute.server_external_events [req-255a8ef5-eafb-40cb-829e-d00ad3ced8a6 req-63db04f3-fe99-470e-a1e4-d0eb6d830d12 service nova] Creating event network-changed:e221748f-d034-48b4-8150-5e3a269027a4 for instance 4f1bbb36-8695-4b09-9f25-bfc92ad06a86 on hv-cinder-76810 Jun 29 08:03:28.595083 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-ee0ab249-7154-43b1-b700-5d303611841c tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] 10.222.0.43 "GET /compute/v2.1/servers/4f1bbb36-8695-4b09-9f25-bfc92ad06a86" status: 200 len: 1320 microversion: 2.1 time: 1.854513 Jun 29 08:03:28.596638 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-255a8ef5-eafb-40cb-829e-d00ad3ced8a6 req-63db04f3-fe99-470e-a1e4-d0eb6d830d12 service nova] Acquired lock "compute-rpcapi-router" {{(pid=117889) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 29 08:03:28.599026 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-d4ad440b-903d-43b3-be9e-17dea63896dd None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:03:28.606306 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 20/37] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:03:26 2022] GET /compute/v2.1/servers/4f1bbb36-8695-4b09-9f25-bfc92ad06a86 => generated 1320 bytes in 1867 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:03:28.607291 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-d4ad440b-903d-43b3-be9e-17dea63896dd None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:03:28.609283 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-d4ad440b-903d-43b3-be9e-17dea63896dd None None] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:03:28.614607 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-d4ad440b-903d-43b3-be9e-17dea63896dd None None] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:03:28.622251 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-5f2bbef4-fafe-4cef-a38e-7a3556ec629b tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:03:28.646169 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-5f2bbef4-fafe-4cef-a38e-7a3556ec629b tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] [instance: b4774888-237c-41c5-8c79-7a6e34d17d70] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:03:28.680693 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-5f2bbef4-fafe-4cef-a38e-7a3556ec629b tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:03:28.681591 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-5f2bbef4-fafe-4cef-a38e-7a3556ec629b tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:03:28.683069 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-5f2bbef4-fafe-4cef-a38e-7a3556ec629b tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:03:28.683329 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.compute.rpcapi [None req-d4ad440b-903d-43b3-be9e-17dea63896dd None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 29 08:03:28.685415 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-d4ad440b-903d-43b3-be9e-17dea63896dd None None] Releasing lock "compute-rpcapi-router" {{(pid=117889) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 29 08:03:28.699907 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-5f2bbef4-fafe-4cef-a38e-7a3556ec629b tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:03:28.782781 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-d4ad440b-903d-43b3-be9e-17dea63896dd None None] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.330672 Jun 29 08:03:28.784280 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 18/38] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jun 29 08:03:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1334 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:03:28.814964 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-7c7789d4-aaed-4e68-b406-cf12a1b71e75 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:03:28.816310 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-7c7789d4-aaed-4e68-b406-cf12a1b71e75 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] [instance: d5d97f9b-3f4a-4a5e-89e8-98d55412fe71] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:03:28.854682 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-7c7789d4-aaed-4e68-b406-cf12a1b71e75 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:03:28.855517 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-7c7789d4-aaed-4e68-b406-cf12a1b71e75 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:03:28.857021 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-7c7789d4-aaed-4e68-b406-cf12a1b71e75 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:03:28.878168 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-7c7789d4-aaed-4e68-b406-cf12a1b71e75 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:03:30.098709 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-7c7789d4-aaed-4e68-b406-cf12a1b71e75 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c70c44993ab240b1a5231df4c9d550c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e0c37d941434569b3dbd07e22125210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:03:30.115647 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-7c7789d4-aaed-4e68-b406-cf12a1b71e75 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] 10.222.0.43 "GET /compute/v2.1/servers/d5d97f9b-3f4a-4a5e-89e8-98d55412fe71" status: 200 len: 1362 microversion: 2.1 time: 1.328897 Jun 29 08:03:30.116696 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 19/39] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:03:28 2022] GET /compute/v2.1/servers/d5d97f9b-3f4a-4a5e-89e8-98d55412fe71 => generated 1362 bytes in 1332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:03:30.149186 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-43606b5b-04ba-4232-b0a8-6f0b727d9a6c tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:03:30.150632 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-43606b5b-04ba-4232-b0a8-6f0b727d9a6c tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] [instance: f99567d1-cadf-40c5-b1dc-f86739b2b16c] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:03:30.159308 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-43606b5b-04ba-4232-b0a8-6f0b727d9a6c tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:03:30.160266 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-43606b5b-04ba-4232-b0a8-6f0b727d9a6c tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:03:30.161374 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-43606b5b-04ba-4232-b0a8-6f0b727d9a6c tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:03:30.162260 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-43606b5b-04ba-4232-b0a8-6f0b727d9a6c tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:03:30.357283 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-5f2bbef4-fafe-4cef-a38e-7a3556ec629b tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0800a22846504b0d9c49e1520a69e45b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46c6cdc3217456dba6eda8ff23e9f3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:03:30.367372 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-43606b5b-04ba-4232-b0a8-6f0b727d9a6c tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:03:30.412549 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-43606b5b-04ba-4232-b0a8-6f0b727d9a6c tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:03:30.416898 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-5f2bbef4-fafe-4cef-a38e-7a3556ec629b tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] 10.222.0.43 "GET /compute/v2.1/servers/b4774888-237c-41c5-8c79-7a6e34d17d70" status: 200 len: 1314 microversion: 2.1 time: 1.805713 Jun 29 08:03:30.418631 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-43606b5b-04ba-4232-b0a8-6f0b727d9a6c tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:03:30.420644 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 21/40] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:03:28 2022] GET /compute/v2.1/servers/b4774888-237c-41c5-8c79-7a6e34d17d70 => generated 1314 bytes in 1810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:03:30.422731 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-43606b5b-04ba-4232-b0a8-6f0b727d9a6c tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] 10.222.0.43 "GET /compute/v2.1/servers/f99567d1-cadf-40c5-b1dc-f86739b2b16c" status: 200 len: 1334 microversion: 2.20 time: 0.304388 Jun 29 08:03:30.423335 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 20/41] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 29 08:03:30 2022] GET /compute/v2.1/servers/f99567d1-cadf-40c5-b1dc-f86739b2b16c => generated 1334 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:03:30.436363 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [req-b30ef112-5a44-47b9-9675-c09fbc7a88c5 req-e6e5b8ee-7aab-4188-9fa8-5639334ce82d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b4774888-237c-41c5-8c79-7a6e34d17d70", "tag": "11e73db4-c785-4473-850c-cf5dba7670fc"}]} {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:03:30.456022 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-989d740a-9ee2-4627-93dd-2cdba421b60c tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:03:30.457073 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-989d740a-9ee2-4627-93dd-2cdba421b60c tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] [instance: 4f1bbb36-8695-4b09-9f25-bfc92ad06a86] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:03:30.506199 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [req-b30ef112-5a44-47b9-9675-c09fbc7a88c5 req-e6e5b8ee-7aab-4188-9fa8-5639334ce82d service nova] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:03:30.508753 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [req-b30ef112-5a44-47b9-9675-c09fbc7a88c5 req-e6e5b8ee-7aab-4188-9fa8-5639334ce82d service nova] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:03:30.515364 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-989d740a-9ee2-4627-93dd-2cdba421b60c tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:03:30.516526 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-989d740a-9ee2-4627-93dd-2cdba421b60c tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:03:30.518525 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-989d740a-9ee2-4627-93dd-2cdba421b60c tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:03:30.519810 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-989d740a-9ee2-4627-93dd-2cdba421b60c tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:03:30.550709 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.compute.server_external_events [req-b30ef112-5a44-47b9-9675-c09fbc7a88c5 req-e6e5b8ee-7aab-4188-9fa8-5639334ce82d service nova] Creating event network-changed:11e73db4-c785-4473-850c-cf5dba7670fc for instance b4774888-237c-41c5-8c79-7a6e34d17d70 on hv-cinder-76810 Jun 29 08:03:30.562872 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [req-b30ef112-5a44-47b9-9675-c09fbc7a88c5 req-e6e5b8ee-7aab-4188-9fa8-5639334ce82d service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.136333 Jun 29 08:03:30.566235 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 22/42] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jun 29 08:03:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:03:31.146874 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-844f26d0-29be-4b9c-ac9d-a1d98391bd16 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:03:31.147693 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-844f26d0-29be-4b9c-ac9d-a1d98391bd16 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] [instance: d5d97f9b-3f4a-4a5e-89e8-98d55412fe71] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:03:31.168392 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-844f26d0-29be-4b9c-ac9d-a1d98391bd16 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:03:31.173116 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-844f26d0-29be-4b9c-ac9d-a1d98391bd16 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:03:31.180367 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-844f26d0-29be-4b9c-ac9d-a1d98391bd16 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:03:31.190762 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-844f26d0-29be-4b9c-ac9d-a1d98391bd16 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:03:31.752682 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-989d740a-9ee2-4627-93dd-2cdba421b60c tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4af4eedee24897be2e702ef51873b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab693125979f4bb7b7b3c94061610fe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:03:31.766454 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-989d740a-9ee2-4627-93dd-2cdba421b60c tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] 10.222.0.43 "GET /compute/v2.1/servers/4f1bbb36-8695-4b09-9f25-bfc92ad06a86" status: 200 len: 1320 microversion: 2.1 time: 1.337411 Jun 29 08:03:31.770498 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 21/43] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:03:30 2022] GET /compute/v2.1/servers/4f1bbb36-8695-4b09-9f25-bfc92ad06a86 => generated 1320 bytes in 1347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:03:31.786815 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [req-d3dfb0be-e4b4-4fe1-94b6-a3e9b28ee497 req-7c17bc2a-35b5-4422-99f8-f6f28cc32951 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d5d97f9b-3f4a-4a5e-89e8-98d55412fe71", "tag": "b93d914e-7134-4247-b5f0-de80f217a1e0"}]} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:03:31.802805 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-d3dfb0be-e4b4-4fe1-94b6-a3e9b28ee497 req-7c17bc2a-35b5-4422-99f8-f6f28cc32951 service nova] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:03:31.803286 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-d3dfb0be-e4b4-4fe1-94b6-a3e9b28ee497 req-7c17bc2a-35b5-4422-99f8-f6f28cc32951 service nova] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:03:31.821952 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.compute.server_external_events [req-d3dfb0be-e4b4-4fe1-94b6-a3e9b28ee497 req-7c17bc2a-35b5-4422-99f8-f6f28cc32951 service nova] Creating event network-changed:b93d914e-7134-4247-b5f0-de80f217a1e0 for instance d5d97f9b-3f4a-4a5e-89e8-98d55412fe71 on hv-cinder-76810 Jun 29 08:03:31.828445 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [req-d3dfb0be-e4b4-4fe1-94b6-a3e9b28ee497 req-7c17bc2a-35b5-4422-99f8-f6f28cc32951 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056153 Jun 29 08:03:31.830201 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 22/44] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jun 29 08:03:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:03:31.839648 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-c8b4cc63-4944-4bf0-8648-29a251d71d76 tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:03:31.840729 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-c8b4cc63-4944-4bf0-8648-29a251d71d76 tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] [instance: b4774888-237c-41c5-8c79-7a6e34d17d70] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:03:31.849583 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c8b4cc63-4944-4bf0-8648-29a251d71d76 tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:03:31.850278 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c8b4cc63-4944-4bf0-8648-29a251d71d76 tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:03:31.851872 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c8b4cc63-4944-4bf0-8648-29a251d71d76 tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:03:31.852894 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c8b4cc63-4944-4bf0-8648-29a251d71d76 tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:03:32.050721 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-844f26d0-29be-4b9c-ac9d-a1d98391bd16 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c70c44993ab240b1a5231df4c9d550c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e0c37d941434569b3dbd07e22125210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:03:32.067515 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-844f26d0-29be-4b9c-ac9d-a1d98391bd16 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] 10.222.0.43 "GET /compute/v2.1/servers/d5d97f9b-3f4a-4a5e-89e8-98d55412fe71" status: 200 len: 1362 microversion: 2.1 time: 0.927391 Jun 29 08:03:32.084919 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 23/45] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:03:31 2022] GET /compute/v2.1/servers/d5d97f9b-3f4a-4a5e-89e8-98d55412fe71 => generated 1362 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:03:32.092670 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-cd31df2e-2765-4cc6-9f66-cdac3258849a tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:03:32.098827 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-cd31df2e-2765-4cc6-9f66-cdac3258849a tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] [instance: f99567d1-cadf-40c5-b1dc-f86739b2b16c] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:03:32.112032 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-cd31df2e-2765-4cc6-9f66-cdac3258849a tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:03:32.113117 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-cd31df2e-2765-4cc6-9f66-cdac3258849a tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:03:32.114789 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-cd31df2e-2765-4cc6-9f66-cdac3258849a tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:03:32.115872 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-cd31df2e-2765-4cc6-9f66-cdac3258849a tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:03:32.178240 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-c8b4cc63-4944-4bf0-8648-29a251d71d76 tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0800a22846504b0d9c49e1520a69e45b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46c6cdc3217456dba6eda8ff23e9f3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:03:32.202846 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-c8b4cc63-4944-4bf0-8648-29a251d71d76 tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] 10.222.0.43 "GET /compute/v2.1/servers/b4774888-237c-41c5-8c79-7a6e34d17d70" status: 200 len: 1314 microversion: 2.1 time: 0.368981 Jun 29 08:03:32.207536 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 23/46] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:03:31 2022] GET /compute/v2.1/servers/b4774888-237c-41c5-8c79-7a6e34d17d70 => generated 1314 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:03:32.325476 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-cd31df2e-2765-4cc6-9f66-cdac3258849a tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:03:32.338250 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-cd31df2e-2765-4cc6-9f66-cdac3258849a tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:03:32.340277 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-cd31df2e-2765-4cc6-9f66-cdac3258849a tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:03:32.345682 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-cd31df2e-2765-4cc6-9f66-cdac3258849a tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] 10.222.0.43 "GET /compute/v2.1/servers/f99567d1-cadf-40c5-b1dc-f86739b2b16c" status: 200 len: 1340 microversion: 2.20 time: 0.254680 Jun 29 08:03:32.345682 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 24/47] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 29 08:03:32 2022] GET /compute/v2.1/servers/f99567d1-cadf-40c5-b1dc-f86739b2b16c => generated 1340 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:03:32.790880 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-c1856948-f0a0-442e-bf94-b23627cb0e7f tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:03:32.792202 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-c1856948-f0a0-442e-bf94-b23627cb0e7f tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] [instance: 4f1bbb36-8695-4b09-9f25-bfc92ad06a86] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:03:32.799197 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c1856948-f0a0-442e-bf94-b23627cb0e7f tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:03:32.800144 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c1856948-f0a0-442e-bf94-b23627cb0e7f tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:03:32.801490 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c1856948-f0a0-442e-bf94-b23627cb0e7f tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:03:32.805719 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c1856948-f0a0-442e-bf94-b23627cb0e7f tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:03:33.020306 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-c1856948-f0a0-442e-bf94-b23627cb0e7f tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4af4eedee24897be2e702ef51873b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab693125979f4bb7b7b3c94061610fe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:03:33.029246 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-c1856948-f0a0-442e-bf94-b23627cb0e7f tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] 10.222.0.43 "GET /compute/v2.1/servers/4f1bbb36-8695-4b09-9f25-bfc92ad06a86" status: 200 len: 1320 microversion: 2.1 time: 0.243374 Jun 29 08:03:33.029910 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 24/48] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:03:32 2022] GET /compute/v2.1/servers/4f1bbb36-8695-4b09-9f25-bfc92ad06a86 => generated 1320 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:03:33.095841 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-d89e1667-093d-47f9-bb0e-82c592edda83 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:03:33.098084 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-d89e1667-093d-47f9-bb0e-82c592edda83 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] [instance: d5d97f9b-3f4a-4a5e-89e8-98d55412fe71] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:03:33.109684 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-d89e1667-093d-47f9-bb0e-82c592edda83 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:03:33.110645 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-d89e1667-093d-47f9-bb0e-82c592edda83 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:03:33.112078 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-d89e1667-093d-47f9-bb0e-82c592edda83 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:03:33.112879 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-d89e1667-093d-47f9-bb0e-82c592edda83 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:03:33.236842 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-973650cf-7dc4-4bfa-9e04-e09c10bbf0cf tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:03:33.238946 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-973650cf-7dc4-4bfa-9e04-e09c10bbf0cf tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] [instance: b4774888-237c-41c5-8c79-7a6e34d17d70] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:03:33.266148 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-973650cf-7dc4-4bfa-9e04-e09c10bbf0cf tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:03:33.268055 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-973650cf-7dc4-4bfa-9e04-e09c10bbf0cf tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:03:33.271778 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-973650cf-7dc4-4bfa-9e04-e09c10bbf0cf tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:03:33.278481 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-973650cf-7dc4-4bfa-9e04-e09c10bbf0cf tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:03:33.513927 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-d89e1667-093d-47f9-bb0e-82c592edda83 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c70c44993ab240b1a5231df4c9d550c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e0c37d941434569b3dbd07e22125210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:03:33.525871 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-d89e1667-093d-47f9-bb0e-82c592edda83 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] 10.222.0.43 "GET /compute/v2.1/servers/d5d97f9b-3f4a-4a5e-89e8-98d55412fe71" status: 200 len: 1362 microversion: 2.1 time: 0.437533 Jun 29 08:03:33.526921 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 25/49] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:03:33 2022] GET /compute/v2.1/servers/d5d97f9b-3f4a-4a5e-89e8-98d55412fe71 => generated 1362 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:03:33.534672 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-34b1afd7-0dea-4fd2-84be-1cdfc26fafba tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:03:33.535862 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-34b1afd7-0dea-4fd2-84be-1cdfc26fafba tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] [instance: f99567d1-cadf-40c5-b1dc-f86739b2b16c] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:03:33.544179 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-973650cf-7dc4-4bfa-9e04-e09c10bbf0cf tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0800a22846504b0d9c49e1520a69e45b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46c6cdc3217456dba6eda8ff23e9f3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:03:33.549335 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-34b1afd7-0dea-4fd2-84be-1cdfc26fafba tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:03:33.550795 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-34b1afd7-0dea-4fd2-84be-1cdfc26fafba tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:03:33.552635 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-34b1afd7-0dea-4fd2-84be-1cdfc26fafba tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:03:33.553481 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-34b1afd7-0dea-4fd2-84be-1cdfc26fafba tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:03:33.555495 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-973650cf-7dc4-4bfa-9e04-e09c10bbf0cf tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] 10.222.0.43 "GET /compute/v2.1/servers/b4774888-237c-41c5-8c79-7a6e34d17d70" status: 200 len: 1314 microversion: 2.1 time: 0.332356 Jun 29 08:03:33.557297 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 25/50] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:03:33 2022] GET /compute/v2.1/servers/b4774888-237c-41c5-8c79-7a6e34d17d70 => generated 1314 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 08:03:33.735009 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-34b1afd7-0dea-4fd2-84be-1cdfc26fafba tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:03:33.747153 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-34b1afd7-0dea-4fd2-84be-1cdfc26fafba tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:03:33.748909 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-34b1afd7-0dea-4fd2-84be-1cdfc26fafba tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:03:33.750160 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-34b1afd7-0dea-4fd2-84be-1cdfc26fafba tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] 10.222.0.43 "GET /compute/v2.1/servers/f99567d1-cadf-40c5-b1dc-f86739b2b16c" status: 200 len: 1340 microversion: 2.20 time: 0.221901 Jun 29 08:03:33.750734 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 26/51] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 29 08:03:33 2022] GET /compute/v2.1/servers/f99567d1-cadf-40c5-b1dc-f86739b2b16c => generated 1340 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:03:34.056712 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-7babc59b-873c-4795-ba4a-dff17de5097e tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:03:34.057588 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-7babc59b-873c-4795-ba4a-dff17de5097e tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] [instance: 4f1bbb36-8695-4b09-9f25-bfc92ad06a86] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:03:34.067443 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-7babc59b-873c-4795-ba4a-dff17de5097e tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:03:34.068241 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-7babc59b-873c-4795-ba4a-dff17de5097e tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:03:34.071291 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-7babc59b-873c-4795-ba4a-dff17de5097e tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:03:34.072485 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-7babc59b-873c-4795-ba4a-dff17de5097e tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:03:34.376249 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-7babc59b-873c-4795-ba4a-dff17de5097e tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4af4eedee24897be2e702ef51873b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab693125979f4bb7b7b3c94061610fe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:03:34.392561 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-7babc59b-873c-4795-ba4a-dff17de5097e tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] 10.222.0.43 "GET /compute/v2.1/servers/4f1bbb36-8695-4b09-9f25-bfc92ad06a86" status: 200 len: 1320 microversion: 2.1 time: 0.341752 Jun 29 08:03:34.394541 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 26/52] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:03:34 2022] GET /compute/v2.1/servers/4f1bbb36-8695-4b09-9f25-bfc92ad06a86 => generated 1320 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:03:34.552050 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-6dcb3974-de3c-4b01-be81-105eb2dfcf82 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:03:34.553548 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-6dcb3974-de3c-4b01-be81-105eb2dfcf82 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] [instance: d5d97f9b-3f4a-4a5e-89e8-98d55412fe71] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:03:34.562289 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-6dcb3974-de3c-4b01-be81-105eb2dfcf82 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:03:34.563175 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-6dcb3974-de3c-4b01-be81-105eb2dfcf82 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:03:34.564308 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-6dcb3974-de3c-4b01-be81-105eb2dfcf82 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:03:34.565100 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-6dcb3974-de3c-4b01-be81-105eb2dfcf82 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:03:34.587907 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-4ffdabcc-ffee-408b-b3e0-fa62fe5e32cc tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:03:34.589221 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-4ffdabcc-ffee-408b-b3e0-fa62fe5e32cc tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] [instance: b4774888-237c-41c5-8c79-7a6e34d17d70] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:03:34.605038 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-4ffdabcc-ffee-408b-b3e0-fa62fe5e32cc tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:03:34.605994 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-4ffdabcc-ffee-408b-b3e0-fa62fe5e32cc tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:03:34.607320 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-4ffdabcc-ffee-408b-b3e0-fa62fe5e32cc tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:03:34.607985 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-4ffdabcc-ffee-408b-b3e0-fa62fe5e32cc tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:03:34.923720 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-4ffdabcc-ffee-408b-b3e0-fa62fe5e32cc tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0800a22846504b0d9c49e1520a69e45b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46c6cdc3217456dba6eda8ff23e9f3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:03:34.945367 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-4ffdabcc-ffee-408b-b3e0-fa62fe5e32cc tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] 10.222.0.43 "GET /compute/v2.1/servers/b4774888-237c-41c5-8c79-7a6e34d17d70" status: 200 len: 1314 microversion: 2.1 time: 0.365121 Jun 29 08:03:34.946989 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 27/53] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:03:34 2022] GET /compute/v2.1/servers/b4774888-237c-41c5-8c79-7a6e34d17d70 => generated 1314 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:03:34.954871 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-23f21650-3001-46da-b883-18ff35de2680 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:03:34.956136 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-23f21650-3001-46da-b883-18ff35de2680 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] [instance: f99567d1-cadf-40c5-b1dc-f86739b2b16c] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:03:34.964585 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-23f21650-3001-46da-b883-18ff35de2680 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:03:34.965307 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-23f21650-3001-46da-b883-18ff35de2680 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:03:34.966260 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-23f21650-3001-46da-b883-18ff35de2680 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:03:34.966856 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-23f21650-3001-46da-b883-18ff35de2680 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:03:35.112148 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-23f21650-3001-46da-b883-18ff35de2680 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:03:35.145698 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-23f21650-3001-46da-b883-18ff35de2680 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:03:35.166648 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-23f21650-3001-46da-b883-18ff35de2680 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:03:35.169772 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-23f21650-3001-46da-b883-18ff35de2680 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] 10.222.0.43 "GET /compute/v2.1/servers/f99567d1-cadf-40c5-b1dc-f86739b2b16c" status: 200 len: 1340 microversion: 2.20 time: 0.220710 Jun 29 08:03:35.171432 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 28/54] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 29 08:03:34 2022] GET /compute/v2.1/servers/f99567d1-cadf-40c5-b1dc-f86739b2b16c => generated 1340 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:03:35.436622 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-b666345a-6498-401b-a581-7f7d40e2464a tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:03:35.444099 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-b666345a-6498-401b-a581-7f7d40e2464a tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] [instance: 4f1bbb36-8695-4b09-9f25-bfc92ad06a86] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:03:35.527899 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-b666345a-6498-401b-a581-7f7d40e2464a tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:03:35.537408 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-b666345a-6498-401b-a581-7f7d40e2464a tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:03:35.544675 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-b666345a-6498-401b-a581-7f7d40e2464a tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:03:35.547191 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-b666345a-6498-401b-a581-7f7d40e2464a tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:03:35.980344 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-6dcb3974-de3c-4b01-be81-105eb2dfcf82 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c70c44993ab240b1a5231df4c9d550c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e0c37d941434569b3dbd07e22125210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:03:35.999037 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-6dcb3974-de3c-4b01-be81-105eb2dfcf82 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] 10.222.0.43 "GET /compute/v2.1/servers/d5d97f9b-3f4a-4a5e-89e8-98d55412fe71" status: 200 len: 1362 microversion: 2.1 time: 1.452288 Jun 29 08:03:35.999639 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 27/55] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:03:34 2022] GET /compute/v2.1/servers/d5d97f9b-3f4a-4a5e-89e8-98d55412fe71 => generated 1362 bytes in 1454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:03:36.014623 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-ae4ce48d-2d61-419d-9974-4de281995a26 tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:03:36.026912 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-ae4ce48d-2d61-419d-9974-4de281995a26 tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] [instance: b4774888-237c-41c5-8c79-7a6e34d17d70] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:03:36.041342 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-ae4ce48d-2d61-419d-9974-4de281995a26 tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:03:36.042281 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-ae4ce48d-2d61-419d-9974-4de281995a26 tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:03:36.046401 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-ae4ce48d-2d61-419d-9974-4de281995a26 tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:03:36.047099 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-ae4ce48d-2d61-419d-9974-4de281995a26 tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:03:36.099465 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-b666345a-6498-401b-a581-7f7d40e2464a tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4af4eedee24897be2e702ef51873b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab693125979f4bb7b7b3c94061610fe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:03:36.121323 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-b666345a-6498-401b-a581-7f7d40e2464a tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] 10.222.0.43 "GET /compute/v2.1/servers/4f1bbb36-8695-4b09-9f25-bfc92ad06a86" status: 200 len: 1320 microversion: 2.1 time: 0.706553 Jun 29 08:03:36.134245 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 29/56] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:03:35 2022] GET /compute/v2.1/servers/4f1bbb36-8695-4b09-9f25-bfc92ad06a86 => generated 1320 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:03:36.193374 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-3b2eedbc-3a77-49f6-8cb1-b940a5ec944d tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:03:36.195181 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-3b2eedbc-3a77-49f6-8cb1-b940a5ec944d tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] [instance: f99567d1-cadf-40c5-b1dc-f86739b2b16c] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:03:36.211856 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-3b2eedbc-3a77-49f6-8cb1-b940a5ec944d tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:03:36.212608 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-3b2eedbc-3a77-49f6-8cb1-b940a5ec944d tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:03:36.213939 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-3b2eedbc-3a77-49f6-8cb1-b940a5ec944d tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:03:36.220148 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-3b2eedbc-3a77-49f6-8cb1-b940a5ec944d tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:03:36.435270 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-ae4ce48d-2d61-419d-9974-4de281995a26 tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0800a22846504b0d9c49e1520a69e45b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46c6cdc3217456dba6eda8ff23e9f3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:03:36.475159 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-ae4ce48d-2d61-419d-9974-4de281995a26 tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] 10.222.0.43 "GET /compute/v2.1/servers/b4774888-237c-41c5-8c79-7a6e34d17d70" status: 200 len: 1314 microversion: 2.1 time: 0.469134 Jun 29 08:03:36.477051 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 28/57] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:03:36 2022] GET /compute/v2.1/servers/b4774888-237c-41c5-8c79-7a6e34d17d70 => generated 1314 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:03:36.736513 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-3b2eedbc-3a77-49f6-8cb1-b940a5ec944d tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:03:36.756275 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-3b2eedbc-3a77-49f6-8cb1-b940a5ec944d tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:03:36.761269 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-3b2eedbc-3a77-49f6-8cb1-b940a5ec944d tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:03:36.763456 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-3b2eedbc-3a77-49f6-8cb1-b940a5ec944d tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] 10.222.0.43 "GET /compute/v2.1/servers/f99567d1-cadf-40c5-b1dc-f86739b2b16c" status: 200 len: 1340 microversion: 2.20 time: 0.575119 Jun 29 08:03:36.764374 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 30/58] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 29 08:03:36 2022] GET /compute/v2.1/servers/f99567d1-cadf-40c5-b1dc-f86739b2b16c => generated 1340 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 29 08:03:37.030058 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-8c11b1a8-24d1-4442-97b4-5bb58392d338 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:03:37.033113 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-8c11b1a8-24d1-4442-97b4-5bb58392d338 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] [instance: d5d97f9b-3f4a-4a5e-89e8-98d55412fe71] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:03:37.052708 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG dbcounter [-] [117890] Writing DB stats nova_cell0:SELECT=2 {{(pid=117890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:03:37.059644 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-8c11b1a8-24d1-4442-97b4-5bb58392d338 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:03:37.060942 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-8c11b1a8-24d1-4442-97b4-5bb58392d338 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:03:37.062692 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-8c11b1a8-24d1-4442-97b4-5bb58392d338 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:03:37.063706 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-8c11b1a8-24d1-4442-97b4-5bb58392d338 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:03:37.146543 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-5656552e-3b91-42f3-8652-c703bd105c99 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:03:37.148661 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-5656552e-3b91-42f3-8652-c703bd105c99 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] [instance: 4f1bbb36-8695-4b09-9f25-bfc92ad06a86] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:03:37.176771 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-5656552e-3b91-42f3-8652-c703bd105c99 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:03:37.194120 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-5656552e-3b91-42f3-8652-c703bd105c99 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:03:37.198901 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-5656552e-3b91-42f3-8652-c703bd105c99 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:03:37.204019 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-5656552e-3b91-42f3-8652-c703bd105c99 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:03:37.302932 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_cell0:SELECT=6 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:03:37.708766 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-8c11b1a8-24d1-4442-97b4-5bb58392d338 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c70c44993ab240b1a5231df4c9d550c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e0c37d941434569b3dbd07e22125210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:03:37.725232 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-8c11b1a8-24d1-4442-97b4-5bb58392d338 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] 10.222.0.43 "GET /compute/v2.1/servers/d5d97f9b-3f4a-4a5e-89e8-98d55412fe71" status: 200 len: 1362 microversion: 2.1 time: 0.708055 Jun 29 08:03:37.731486 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 29/59] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:03:37 2022] GET /compute/v2.1/servers/d5d97f9b-3f4a-4a5e-89e8-98d55412fe71 => generated 1362 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:03:37.746083 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-329e33d1-054e-4deb-8225-cef6613a72fd tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:03:37.746981 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-329e33d1-054e-4deb-8225-cef6613a72fd tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] [instance: b4774888-237c-41c5-8c79-7a6e34d17d70] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:03:37.754151 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-329e33d1-054e-4deb-8225-cef6613a72fd tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:03:37.754908 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-329e33d1-054e-4deb-8225-cef6613a72fd tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:03:37.755996 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-329e33d1-054e-4deb-8225-cef6613a72fd tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:03:37.756646 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-329e33d1-054e-4deb-8225-cef6613a72fd tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:03:37.828422 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-5656552e-3b91-42f3-8652-c703bd105c99 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4af4eedee24897be2e702ef51873b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab693125979f4bb7b7b3c94061610fe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:03:37.842959 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-5656552e-3b91-42f3-8652-c703bd105c99 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] 10.222.0.43 "GET /compute/v2.1/servers/4f1bbb36-8695-4b09-9f25-bfc92ad06a86" status: 200 len: 1320 microversion: 2.1 time: 0.702692 Jun 29 08:03:37.843700 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 31/60] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:03:37 2022] GET /compute/v2.1/servers/4f1bbb36-8695-4b09-9f25-bfc92ad06a86 => generated 1320 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 08:03:37.851499 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-cea36a02-0a4d-43cc-bb15-25275e71667b tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:03:37.854475 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-cea36a02-0a4d-43cc-bb15-25275e71667b tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] [instance: f99567d1-cadf-40c5-b1dc-f86739b2b16c] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:03:37.871394 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-cea36a02-0a4d-43cc-bb15-25275e71667b tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:03:37.871879 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-cea36a02-0a4d-43cc-bb15-25275e71667b tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:03:37.872768 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-cea36a02-0a4d-43cc-bb15-25275e71667b tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:03:37.873306 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-cea36a02-0a4d-43cc-bb15-25275e71667b tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:03:38.052141 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-329e33d1-054e-4deb-8225-cef6613a72fd tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0800a22846504b0d9c49e1520a69e45b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46c6cdc3217456dba6eda8ff23e9f3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:03:38.060918 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-329e33d1-054e-4deb-8225-cef6613a72fd tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] 10.222.0.43 "GET /compute/v2.1/servers/b4774888-237c-41c5-8c79-7a6e34d17d70" status: 200 len: 1314 microversion: 2.1 time: 0.327827 Jun 29 08:03:38.063308 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 30/61] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:03:37 2022] GET /compute/v2.1/servers/b4774888-237c-41c5-8c79-7a6e34d17d70 => generated 1314 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:03:38.148151 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-cea36a02-0a4d-43cc-bb15-25275e71667b tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:03:38.174320 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-cea36a02-0a4d-43cc-bb15-25275e71667b tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:03:38.177554 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-cea36a02-0a4d-43cc-bb15-25275e71667b tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:03:38.182549 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-cea36a02-0a4d-43cc-bb15-25275e71667b tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] 10.222.0.43 "GET /compute/v2.1/servers/f99567d1-cadf-40c5-b1dc-f86739b2b16c" status: 200 len: 1408 microversion: 2.20 time: 0.337139 Jun 29 08:03:38.198849 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 32/62] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 29 08:03:37 2022] GET /compute/v2.1/servers/f99567d1-cadf-40c5-b1dc-f86739b2b16c => generated 1408 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:03:38.758489 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-4650196d-0209-4a13-b6de-a0add3408c25 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:03:38.759512 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-4650196d-0209-4a13-b6de-a0add3408c25 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] [instance: d5d97f9b-3f4a-4a5e-89e8-98d55412fe71] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:03:38.778003 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-4650196d-0209-4a13-b6de-a0add3408c25 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:03:38.779546 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-4650196d-0209-4a13-b6de-a0add3408c25 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:03:38.782087 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-4650196d-0209-4a13-b6de-a0add3408c25 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:03:38.783407 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-4650196d-0209-4a13-b6de-a0add3408c25 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:03:38.871345 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-d7980e7b-785e-4bdc-8573-527026c48d10 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:03:38.875267 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-d7980e7b-785e-4bdc-8573-527026c48d10 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] [instance: 4f1bbb36-8695-4b09-9f25-bfc92ad06a86] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:03:38.881244 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_cell0:SELECT=4 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:03:38.943558 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-d7980e7b-785e-4bdc-8573-527026c48d10 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:03:38.945869 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-d7980e7b-785e-4bdc-8573-527026c48d10 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:03:38.949876 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-d7980e7b-785e-4bdc-8573-527026c48d10 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:03:38.950975 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-d7980e7b-785e-4bdc-8573-527026c48d10 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:03:39.593086 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-d7980e7b-785e-4bdc-8573-527026c48d10 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4af4eedee24897be2e702ef51873b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab693125979f4bb7b7b3c94061610fe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:03:39.608303 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-d7980e7b-785e-4bdc-8573-527026c48d10 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] 10.222.0.43 "GET /compute/v2.1/servers/4f1bbb36-8695-4b09-9f25-bfc92ad06a86" status: 200 len: 1320 microversion: 2.1 time: 0.745469 Jun 29 08:03:39.618135 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 33/63] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:03:38 2022] GET /compute/v2.1/servers/4f1bbb36-8695-4b09-9f25-bfc92ad06a86 => generated 1320 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:03:39.639327 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-de61289e-00a3-4376-9e4a-80f11f947939 tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:03:39.640107 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-de61289e-00a3-4376-9e4a-80f11f947939 tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] [instance: b4774888-237c-41c5-8c79-7a6e34d17d70] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:03:39.659964 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-de61289e-00a3-4376-9e4a-80f11f947939 tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:03:39.660652 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-de61289e-00a3-4376-9e4a-80f11f947939 tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:03:39.661622 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-de61289e-00a3-4376-9e4a-80f11f947939 tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:03:39.662131 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-de61289e-00a3-4376-9e4a-80f11f947939 tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:03:40.153146 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-de61289e-00a3-4376-9e4a-80f11f947939 tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0800a22846504b0d9c49e1520a69e45b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46c6cdc3217456dba6eda8ff23e9f3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:03:40.162939 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-de61289e-00a3-4376-9e4a-80f11f947939 tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] 10.222.0.43 "GET /compute/v2.1/servers/b4774888-237c-41c5-8c79-7a6e34d17d70" status: 200 len: 1314 microversion: 2.1 time: 0.543503 Jun 29 08:03:40.165534 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 34/64] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:03:39 2022] GET /compute/v2.1/servers/b4774888-237c-41c5-8c79-7a6e34d17d70 => generated 1314 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:03:40.170906 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-720a7660-bb95-426e-8008-6c28fe991da9 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:03:40.171816 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-720a7660-bb95-426e-8008-6c28fe991da9 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] [instance: f99567d1-cadf-40c5-b1dc-f86739b2b16c] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:03:40.180179 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-720a7660-bb95-426e-8008-6c28fe991da9 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:03:40.184507 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-4650196d-0209-4a13-b6de-a0add3408c25 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c70c44993ab240b1a5231df4c9d550c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e0c37d941434569b3dbd07e22125210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:03:40.189281 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-720a7660-bb95-426e-8008-6c28fe991da9 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:03:40.194135 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-720a7660-bb95-426e-8008-6c28fe991da9 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:03:40.196881 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-720a7660-bb95-426e-8008-6c28fe991da9 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:03:40.200901 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-4650196d-0209-4a13-b6de-a0add3408c25 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] 10.222.0.43 "GET /compute/v2.1/servers/d5d97f9b-3f4a-4a5e-89e8-98d55412fe71" status: 200 len: 1362 microversion: 2.1 time: 1.451432 Jun 29 08:03:40.201993 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 31/65] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:03:38 2022] GET /compute/v2.1/servers/d5d97f9b-3f4a-4a5e-89e8-98d55412fe71 => generated 1362 bytes in 1459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 08:03:40.639246 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-d26732c8-7578-42af-88ae-529d9e440562 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:03:40.639911 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-d26732c8-7578-42af-88ae-529d9e440562 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] [instance: 4f1bbb36-8695-4b09-9f25-bfc92ad06a86] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:03:40.659675 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-d26732c8-7578-42af-88ae-529d9e440562 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:03:40.660971 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-d26732c8-7578-42af-88ae-529d9e440562 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:03:40.664378 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-d26732c8-7578-42af-88ae-529d9e440562 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:03:40.665600 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-d26732c8-7578-42af-88ae-529d9e440562 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:03:40.847878 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-720a7660-bb95-426e-8008-6c28fe991da9 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:03:40.859016 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_cell1:SELECT=100 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:03:40.972933 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-720a7660-bb95-426e-8008-6c28fe991da9 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:03:40.980484 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-720a7660-bb95-426e-8008-6c28fe991da9 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:03:40.983339 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-720a7660-bb95-426e-8008-6c28fe991da9 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] 10.222.0.43 "GET /compute/v2.1/servers/f99567d1-cadf-40c5-b1dc-f86739b2b16c" status: 200 len: 1408 microversion: 2.20 time: 0.816403 Jun 29 08:03:40.984512 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 35/66] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 29 08:03:40 2022] GET /compute/v2.1/servers/f99567d1-cadf-40c5-b1dc-f86739b2b16c => generated 1408 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:03:41.006598 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [req-22f8e1ba-cf3a-46e5-a69c-7b09170b012f req-589fce9a-5bbf-4fbd-a181-34ef6e56c5ab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f99567d1-cadf-40c5-b1dc-f86739b2b16c", "tag": "dfb8e71b-41e2-4d03-8de7-4f7323f5b53b"}]} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:03:41.048469 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-22f8e1ba-cf3a-46e5-a69c-7b09170b012f req-589fce9a-5bbf-4fbd-a181-34ef6e56c5ab service nova] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:03:41.049015 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-22f8e1ba-cf3a-46e5-a69c-7b09170b012f req-589fce9a-5bbf-4fbd-a181-34ef6e56c5ab service nova] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:03:41.098576 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.compute.server_external_events [req-22f8e1ba-cf3a-46e5-a69c-7b09170b012f req-589fce9a-5bbf-4fbd-a181-34ef6e56c5ab service nova] Creating event network-changed:dfb8e71b-41e2-4d03-8de7-4f7323f5b53b for instance f99567d1-cadf-40c5-b1dc-f86739b2b16c on hv-cinder-76810 Jun 29 08:03:41.117325 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [req-22f8e1ba-cf3a-46e5-a69c-7b09170b012f req-589fce9a-5bbf-4fbd-a181-34ef6e56c5ab service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.126935 Jun 29 08:03:41.118863 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 36/67] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jun 29 08:03:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:03:41.188453 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-37aee765-bc24-45e2-8ee0-3818417057ea tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:03:41.203849 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-37aee765-bc24-45e2-8ee0-3818417057ea tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] [instance: b4774888-237c-41c5-8c79-7a6e34d17d70] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:03:41.230729 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-37aee765-bc24-45e2-8ee0-3818417057ea tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:03:41.231399 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-37aee765-bc24-45e2-8ee0-3818417057ea tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:03:41.245434 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-37aee765-bc24-45e2-8ee0-3818417057ea tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:03:41.245895 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-37aee765-bc24-45e2-8ee0-3818417057ea tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:03:41.696829 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-37aee765-bc24-45e2-8ee0-3818417057ea tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0800a22846504b0d9c49e1520a69e45b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46c6cdc3217456dba6eda8ff23e9f3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:03:41.758857 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-37aee765-bc24-45e2-8ee0-3818417057ea tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] 10.222.0.43 "GET /compute/v2.1/servers/b4774888-237c-41c5-8c79-7a6e34d17d70" status: 200 len: 1314 microversion: 2.1 time: 0.578120 Jun 29 08:03:41.761217 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 37/68] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:03:41 2022] GET /compute/v2.1/servers/b4774888-237c-41c5-8c79-7a6e34d17d70 => generated 1314 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:03:41.790354 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-49cf7373-d09d-43e3-be4b-fff116314af0 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:03:41.791722 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-49cf7373-d09d-43e3-be4b-fff116314af0 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] [instance: d5d97f9b-3f4a-4a5e-89e8-98d55412fe71] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:03:41.796330 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-d26732c8-7578-42af-88ae-529d9e440562 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4af4eedee24897be2e702ef51873b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab693125979f4bb7b7b3c94061610fe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:03:41.806720 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-49cf7373-d09d-43e3-be4b-fff116314af0 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:03:41.807501 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-49cf7373-d09d-43e3-be4b-fff116314af0 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:03:41.809388 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-d26732c8-7578-42af-88ae-529d9e440562 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] 10.222.0.43 "GET /compute/v2.1/servers/4f1bbb36-8695-4b09-9f25-bfc92ad06a86" status: 200 len: 1320 microversion: 2.1 time: 1.174104 Jun 29 08:03:41.810322 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-49cf7373-d09d-43e3-be4b-fff116314af0 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:03:41.812007 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-49cf7373-d09d-43e3-be4b-fff116314af0 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:03:41.823199 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 32/69] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:03:40 2022] GET /compute/v2.1/servers/4f1bbb36-8695-4b09-9f25-bfc92ad06a86 => generated 1320 bytes in 1188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:03:42.025946 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-fb40a80c-3a10-4370-84ae-cc463d2f80d2 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:03:42.028288 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-fb40a80c-3a10-4370-84ae-cc463d2f80d2 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] [instance: f99567d1-cadf-40c5-b1dc-f86739b2b16c] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:03:42.042788 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-fb40a80c-3a10-4370-84ae-cc463d2f80d2 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:03:42.044732 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-fb40a80c-3a10-4370-84ae-cc463d2f80d2 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:03:42.046512 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-49cf7373-d09d-43e3-be4b-fff116314af0 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c70c44993ab240b1a5231df4c9d550c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e0c37d941434569b3dbd07e22125210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:03:42.047196 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-fb40a80c-3a10-4370-84ae-cc463d2f80d2 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:03:42.047662 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-fb40a80c-3a10-4370-84ae-cc463d2f80d2 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:03:42.065319 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-49cf7373-d09d-43e3-be4b-fff116314af0 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] 10.222.0.43 "GET /compute/v2.1/servers/d5d97f9b-3f4a-4a5e-89e8-98d55412fe71" status: 200 len: 1362 microversion: 2.1 time: 0.301732 Jun 29 08:03:42.089751 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 38/70] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:03:41 2022] GET /compute/v2.1/servers/d5d97f9b-3f4a-4a5e-89e8-98d55412fe71 => generated 1362 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:03:42.124450 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG dbcounter [-] [117890] Writing DB stats nova_cell1:SELECT=100 {{(pid=117890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:03:42.478281 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-fb40a80c-3a10-4370-84ae-cc463d2f80d2 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:03:42.497139 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-fb40a80c-3a10-4370-84ae-cc463d2f80d2 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:03:42.498734 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-fb40a80c-3a10-4370-84ae-cc463d2f80d2 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:03:42.500077 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-fb40a80c-3a10-4370-84ae-cc463d2f80d2 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] 10.222.0.43 "GET /compute/v2.1/servers/f99567d1-cadf-40c5-b1dc-f86739b2b16c" status: 200 len: 1408 microversion: 2.20 time: 0.487616 Jun 29 08:03:42.511986 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 33/71] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 29 08:03:42 2022] GET /compute/v2.1/servers/f99567d1-cadf-40c5-b1dc-f86739b2b16c => generated 1408 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:03:42.543323 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [req-89ad3500-745c-4516-b069-f9e7ba0d2427 req-1f499ab8-f030-4b83-8e63-496f66c5f597 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79765057-c430-4292-bc5f-ee0c6a66b367", "name": "network-vif-plugged", "status": "completed", "tag": "fcb56668-c13f-4fb2-83eb-845e29b080ce"}]} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:03:42.559465 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-89ad3500-745c-4516-b069-f9e7ba0d2427 req-1f499ab8-f030-4b83-8e63-496f66c5f597 service nova] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:03:42.560796 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-89ad3500-745c-4516-b069-f9e7ba0d2427 req-1f499ab8-f030-4b83-8e63-496f66c5f597 service nova] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:03:42.580715 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.compute.server_external_events [req-89ad3500-745c-4516-b069-f9e7ba0d2427 req-1f499ab8-f030-4b83-8e63-496f66c5f597 service nova] Creating event network-vif-plugged:fcb56668-c13f-4fb2-83eb-845e29b080ce for instance 79765057-c430-4292-bc5f-ee0c6a66b367 on hv-cinder-76810 Jun 29 08:03:42.590201 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [req-89ad3500-745c-4516-b069-f9e7ba0d2427 req-1f499ab8-f030-4b83-8e63-496f66c5f597 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.179076 Jun 29 08:03:42.591187 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 39/72] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jun 29 08:03:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:03:42.788078 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-d5bbc44f-17d0-494e-83bd-dee838758d07 tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:03:42.789670 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-d5bbc44f-17d0-494e-83bd-dee838758d07 tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] [instance: b4774888-237c-41c5-8c79-7a6e34d17d70] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:03:42.811247 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-d5bbc44f-17d0-494e-83bd-dee838758d07 tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:03:42.812840 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-d5bbc44f-17d0-494e-83bd-dee838758d07 tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:03:42.814649 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-d5bbc44f-17d0-494e-83bd-dee838758d07 tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:03:42.815491 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-d5bbc44f-17d0-494e-83bd-dee838758d07 tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:03:42.828454 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-354be833-5232-4fe6-a98c-3c8cc97684c0 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:03:42.829599 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-354be833-5232-4fe6-a98c-3c8cc97684c0 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] [instance: 4f1bbb36-8695-4b09-9f25-bfc92ad06a86] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:03:42.851751 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-354be833-5232-4fe6-a98c-3c8cc97684c0 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:03:42.855621 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-354be833-5232-4fe6-a98c-3c8cc97684c0 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:03:42.859467 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-354be833-5232-4fe6-a98c-3c8cc97684c0 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:03:42.860027 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-354be833-5232-4fe6-a98c-3c8cc97684c0 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:03:43.185290 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-d5bbc44f-17d0-494e-83bd-dee838758d07 tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0800a22846504b0d9c49e1520a69e45b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46c6cdc3217456dba6eda8ff23e9f3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:03:43.198190 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-d5bbc44f-17d0-494e-83bd-dee838758d07 tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] 10.222.0.43 "GET /compute/v2.1/servers/b4774888-237c-41c5-8c79-7a6e34d17d70" status: 200 len: 1314 microversion: 2.1 time: 0.423950 Jun 29 08:03:43.209444 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 34/73] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:03:42 2022] GET /compute/v2.1/servers/b4774888-237c-41c5-8c79-7a6e34d17d70 => generated 1314 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:03:43.216744 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-5a155daa-9de2-4dcb-a0e7-bfafa93b90fa tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:03:43.218008 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-5a155daa-9de2-4dcb-a0e7-bfafa93b90fa tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] [instance: d5d97f9b-3f4a-4a5e-89e8-98d55412fe71] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:03:43.231859 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-5a155daa-9de2-4dcb-a0e7-bfafa93b90fa tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:03:43.232841 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-5a155daa-9de2-4dcb-a0e7-bfafa93b90fa tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:03:43.234250 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-5a155daa-9de2-4dcb-a0e7-bfafa93b90fa tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:03:43.235267 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-5a155daa-9de2-4dcb-a0e7-bfafa93b90fa tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:03:43.280159 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-354be833-5232-4fe6-a98c-3c8cc97684c0 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4af4eedee24897be2e702ef51873b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab693125979f4bb7b7b3c94061610fe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:03:43.300165 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-354be833-5232-4fe6-a98c-3c8cc97684c0 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] 10.222.0.43 "GET /compute/v2.1/servers/4f1bbb36-8695-4b09-9f25-bfc92ad06a86" status: 200 len: 1320 microversion: 2.1 time: 0.474334 Jun 29 08:03:43.302120 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 40/74] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:03:42 2022] GET /compute/v2.1/servers/4f1bbb36-8695-4b09-9f25-bfc92ad06a86 => generated 1320 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 08:03:43.525804 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-5d6288e2-dc79-4581-855c-6c0323ea6317 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:03:43.530921 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-5d6288e2-dc79-4581-855c-6c0323ea6317 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] [instance: f99567d1-cadf-40c5-b1dc-f86739b2b16c] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:03:43.549513 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-5d6288e2-dc79-4581-855c-6c0323ea6317 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:03:43.551107 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-5d6288e2-dc79-4581-855c-6c0323ea6317 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:03:43.552683 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-5d6288e2-dc79-4581-855c-6c0323ea6317 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:03:43.554307 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-5d6288e2-dc79-4581-855c-6c0323ea6317 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:03:43.858948 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-5a155daa-9de2-4dcb-a0e7-bfafa93b90fa tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c70c44993ab240b1a5231df4c9d550c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e0c37d941434569b3dbd07e22125210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:03:43.899412 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-5a155daa-9de2-4dcb-a0e7-bfafa93b90fa tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] 10.222.0.43 "GET /compute/v2.1/servers/d5d97f9b-3f4a-4a5e-89e8-98d55412fe71" status: 200 len: 1362 microversion: 2.1 time: 0.676452 Jun 29 08:03:43.899412 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 35/75] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:03:43 2022] GET /compute/v2.1/servers/d5d97f9b-3f4a-4a5e-89e8-98d55412fe71 => generated 1362 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:03:44.221592 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-e4682d3e-dac0-4174-a8d1-e9ccb1bf29fe tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:03:44.223442 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-e4682d3e-dac0-4174-a8d1-e9ccb1bf29fe tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] [instance: b4774888-237c-41c5-8c79-7a6e34d17d70] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:03:44.236108 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-e4682d3e-dac0-4174-a8d1-e9ccb1bf29fe tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:03:44.237502 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-e4682d3e-dac0-4174-a8d1-e9ccb1bf29fe tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:03:44.239367 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-e4682d3e-dac0-4174-a8d1-e9ccb1bf29fe tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:03:44.240523 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-e4682d3e-dac0-4174-a8d1-e9ccb1bf29fe tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:03:44.468939 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-5d6288e2-dc79-4581-855c-6c0323ea6317 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:03:44.496512 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-5d6288e2-dc79-4581-855c-6c0323ea6317 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:03:44.504661 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-5d6288e2-dc79-4581-855c-6c0323ea6317 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:03:44.519130 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-5d6288e2-dc79-4581-855c-6c0323ea6317 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] 10.222.0.43 "GET /compute/v2.1/servers/f99567d1-cadf-40c5-b1dc-f86739b2b16c" status: 200 len: 1408 microversion: 2.20 time: 0.994728 Jun 29 08:03:44.519843 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 41/76] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 29 08:03:43 2022] GET /compute/v2.1/servers/f99567d1-cadf-40c5-b1dc-f86739b2b16c => generated 1408 bytes in 1004 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:03:44.530662 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-c68403f9-ee85-4b09-8925-74379b978e7c tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:03:44.531288 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-c68403f9-ee85-4b09-8925-74379b978e7c tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] [instance: 4f1bbb36-8695-4b09-9f25-bfc92ad06a86] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:03:44.577547 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c68403f9-ee85-4b09-8925-74379b978e7c tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:03:44.578093 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c68403f9-ee85-4b09-8925-74379b978e7c tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:03:44.578939 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c68403f9-ee85-4b09-8925-74379b978e7c tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:03:44.579389 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c68403f9-ee85-4b09-8925-74379b978e7c tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:03:44.582193 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-e4682d3e-dac0-4174-a8d1-e9ccb1bf29fe tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0800a22846504b0d9c49e1520a69e45b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46c6cdc3217456dba6eda8ff23e9f3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:03:44.601704 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-e4682d3e-dac0-4174-a8d1-e9ccb1bf29fe tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] 10.222.0.43 "GET /compute/v2.1/servers/b4774888-237c-41c5-8c79-7a6e34d17d70" status: 200 len: 1314 microversion: 2.1 time: 0.386943 Jun 29 08:03:44.613597 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 36/77] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:03:44 2022] GET /compute/v2.1/servers/b4774888-237c-41c5-8c79-7a6e34d17d70 => generated 1314 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:03:44.682382 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [req-6ca349e6-7367-40ae-be33-a91166996a3e req-51cda519-c992-4048-944e-f7eb8d4a004a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f1bbb36-8695-4b09-9f25-bfc92ad06a86", "name": "network-vif-plugged", "status": "completed", "tag": "e221748f-d034-48b4-8150-5e3a269027a4"}, {"server_uuid": "d5d97f9b-3f4a-4a5e-89e8-98d55412fe71", "name": "network-vif-plugged", "status": "completed", "tag": "b93d914e-7134-4247-b5f0-de80f217a1e0"}]} {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:03:44.699760 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [req-6ca349e6-7367-40ae-be33-a91166996a3e req-51cda519-c992-4048-944e-f7eb8d4a004a service nova] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:03:44.702929 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [req-6ca349e6-7367-40ae-be33-a91166996a3e req-51cda519-c992-4048-944e-f7eb8d4a004a service nova] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:03:44.737262 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.compute.server_external_events [req-6ca349e6-7367-40ae-be33-a91166996a3e req-51cda519-c992-4048-944e-f7eb8d4a004a service nova] Creating event network-vif-plugged:e221748f-d034-48b4-8150-5e3a269027a4 for instance 4f1bbb36-8695-4b09-9f25-bfc92ad06a86 on hv-cinder-76810 Jun 29 08:03:44.738485 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.compute.server_external_events [req-6ca349e6-7367-40ae-be33-a91166996a3e req-51cda519-c992-4048-944e-f7eb8d4a004a service nova] Creating event network-vif-plugged:b93d914e-7134-4247-b5f0-de80f217a1e0 for instance d5d97f9b-3f4a-4a5e-89e8-98d55412fe71 on hv-cinder-76810 Jun 29 08:03:44.776589 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [req-6ca349e6-7367-40ae-be33-a91166996a3e req-51cda519-c992-4048-944e-f7eb8d4a004a service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.098916 Jun 29 08:03:44.779710 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 37/78] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jun 29 08:03:44 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 29 08:03:44.948259 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-e54d7936-fcb0-437a-ad59-7e257a4d322a tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:03:44.949934 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-e54d7936-fcb0-437a-ad59-7e257a4d322a tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] [instance: d5d97f9b-3f4a-4a5e-89e8-98d55412fe71] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:03:44.966437 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-e54d7936-fcb0-437a-ad59-7e257a4d322a tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:03:44.967782 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-e54d7936-fcb0-437a-ad59-7e257a4d322a tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:03:44.969582 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-e54d7936-fcb0-437a-ad59-7e257a4d322a tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:03:44.970522 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-c68403f9-ee85-4b09-8925-74379b978e7c tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4af4eedee24897be2e702ef51873b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab693125979f4bb7b7b3c94061610fe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:03:44.971038 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-e54d7936-fcb0-437a-ad59-7e257a4d322a tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:03:44.993761 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-c68403f9-ee85-4b09-8925-74379b978e7c tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] 10.222.0.43 "GET /compute/v2.1/servers/4f1bbb36-8695-4b09-9f25-bfc92ad06a86" status: 200 len: 1320 microversion: 2.1 time: 0.472299 Jun 29 08:03:44.994789 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 42/79] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:03:44 2022] GET /compute/v2.1/servers/4f1bbb36-8695-4b09-9f25-bfc92ad06a86 => generated 1320 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:03:45.314759 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-e54d7936-fcb0-437a-ad59-7e257a4d322a tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c70c44993ab240b1a5231df4c9d550c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e0c37d941434569b3dbd07e22125210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:03:45.362407 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-e54d7936-fcb0-437a-ad59-7e257a4d322a tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] 10.222.0.43 "GET /compute/v2.1/servers/d5d97f9b-3f4a-4a5e-89e8-98d55412fe71" status: 200 len: 1362 microversion: 2.1 time: 0.425831 Jun 29 08:03:45.363557 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 38/80] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:03:44 2022] GET /compute/v2.1/servers/d5d97f9b-3f4a-4a5e-89e8-98d55412fe71 => generated 1362 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 08:03:45.558328 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-a67fce0b-e2cc-456f-ac3d-039be06f38eb tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:03:45.560815 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-a67fce0b-e2cc-456f-ac3d-039be06f38eb tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] [instance: f99567d1-cadf-40c5-b1dc-f86739b2b16c] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:03:45.600113 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-a67fce0b-e2cc-456f-ac3d-039be06f38eb tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:03:45.601486 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-a67fce0b-e2cc-456f-ac3d-039be06f38eb tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:03:45.607014 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-a67fce0b-e2cc-456f-ac3d-039be06f38eb tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:03:45.607734 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-a67fce0b-e2cc-456f-ac3d-039be06f38eb tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:03:45.629538 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-6a779aab-6545-412b-99b9-874acb5c0f3b tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:03:45.630222 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-6a779aab-6545-412b-99b9-874acb5c0f3b tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] [instance: b4774888-237c-41c5-8c79-7a6e34d17d70] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:03:45.657563 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-6a779aab-6545-412b-99b9-874acb5c0f3b tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:03:45.658425 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-6a779aab-6545-412b-99b9-874acb5c0f3b tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:03:45.666605 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-6a779aab-6545-412b-99b9-874acb5c0f3b tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:03:45.668273 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-6a779aab-6545-412b-99b9-874acb5c0f3b tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:03:46.111244 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-6a779aab-6545-412b-99b9-874acb5c0f3b tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0800a22846504b0d9c49e1520a69e45b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46c6cdc3217456dba6eda8ff23e9f3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:03:46.124833 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-6a779aab-6545-412b-99b9-874acb5c0f3b tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] 10.222.0.43 "GET /compute/v2.1/servers/b4774888-237c-41c5-8c79-7a6e34d17d70" status: 200 len: 1314 microversion: 2.1 time: 0.507485 Jun 29 08:03:46.137162 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 39/81] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:03:45 2022] GET /compute/v2.1/servers/b4774888-237c-41c5-8c79-7a6e34d17d70 => generated 1314 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 08:03:46.142865 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-a2cc455f-537c-4354-b78b-740cb25ed811 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:03:46.143829 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-a2cc455f-537c-4354-b78b-740cb25ed811 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] [instance: 4f1bbb36-8695-4b09-9f25-bfc92ad06a86] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:03:46.167172 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-a2cc455f-537c-4354-b78b-740cb25ed811 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:03:46.168627 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-a2cc455f-537c-4354-b78b-740cb25ed811 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:03:46.170642 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-a2cc455f-537c-4354-b78b-740cb25ed811 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:03:46.171805 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-a2cc455f-537c-4354-b78b-740cb25ed811 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:03:46.188890 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-a67fce0b-e2cc-456f-ac3d-039be06f38eb tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:03:46.234617 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-a67fce0b-e2cc-456f-ac3d-039be06f38eb tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:03:46.240897 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-a67fce0b-e2cc-456f-ac3d-039be06f38eb tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:03:46.245505 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-a67fce0b-e2cc-456f-ac3d-039be06f38eb tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] 10.222.0.43 "GET /compute/v2.1/servers/f99567d1-cadf-40c5-b1dc-f86739b2b16c" status: 200 len: 1408 microversion: 2.20 time: 0.698199 Jun 29 08:03:46.247313 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 43/82] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 29 08:03:45 2022] GET /compute/v2.1/servers/f99567d1-cadf-40c5-b1dc-f86739b2b16c => generated 1408 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 29 08:03:46.395928 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-caf12431-0880-42a9-9371-30734f94e17d tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:03:46.396885 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-caf12431-0880-42a9-9371-30734f94e17d tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] [instance: d5d97f9b-3f4a-4a5e-89e8-98d55412fe71] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:03:46.428170 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-caf12431-0880-42a9-9371-30734f94e17d tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:03:46.432355 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-caf12431-0880-42a9-9371-30734f94e17d tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:03:46.433991 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-caf12431-0880-42a9-9371-30734f94e17d tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:03:46.434761 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-caf12431-0880-42a9-9371-30734f94e17d tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:03:46.626571 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-a2cc455f-537c-4354-b78b-740cb25ed811 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4af4eedee24897be2e702ef51873b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab693125979f4bb7b7b3c94061610fe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:03:46.644041 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-a2cc455f-537c-4354-b78b-740cb25ed811 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] 10.222.0.43 "GET /compute/v2.1/servers/4f1bbb36-8695-4b09-9f25-bfc92ad06a86" status: 200 len: 1320 microversion: 2.1 time: 0.505555 Jun 29 08:03:46.645397 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 40/83] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:03:46 2022] GET /compute/v2.1/servers/4f1bbb36-8695-4b09-9f25-bfc92ad06a86 => generated 1320 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:03:46.859723 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [req-3c9242ab-cda9-4eaf-b5b6-7eb6fcb87a04 req-d90c53db-faba-4ca4-a7e9-65ef23d75c7b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4774888-237c-41c5-8c79-7a6e34d17d70", "name": "network-vif-plugged", "status": "completed", "tag": "11e73db4-c785-4473-850c-cf5dba7670fc"}]} {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:03:46.899749 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [req-3c9242ab-cda9-4eaf-b5b6-7eb6fcb87a04 req-d90c53db-faba-4ca4-a7e9-65ef23d75c7b service nova] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:03:46.900480 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [req-3c9242ab-cda9-4eaf-b5b6-7eb6fcb87a04 req-d90c53db-faba-4ca4-a7e9-65ef23d75c7b service nova] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:03:46.905335 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-caf12431-0880-42a9-9371-30734f94e17d tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c70c44993ab240b1a5231df4c9d550c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e0c37d941434569b3dbd07e22125210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:03:46.924194 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.compute.server_external_events [req-3c9242ab-cda9-4eaf-b5b6-7eb6fcb87a04 req-d90c53db-faba-4ca4-a7e9-65ef23d75c7b service nova] Creating event network-vif-plugged:11e73db4-c785-4473-850c-cf5dba7670fc for instance b4774888-237c-41c5-8c79-7a6e34d17d70 on hv-cinder-76810 Jun 29 08:03:46.926407 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-caf12431-0880-42a9-9371-30734f94e17d tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] 10.222.0.43 "GET /compute/v2.1/servers/d5d97f9b-3f4a-4a5e-89e8-98d55412fe71" status: 200 len: 1362 microversion: 2.1 time: 0.534719 Jun 29 08:03:46.933504 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 44/84] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:03:46 2022] GET /compute/v2.1/servers/d5d97f9b-3f4a-4a5e-89e8-98d55412fe71 => generated 1362 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 08:03:46.941468 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [req-3c9242ab-cda9-4eaf-b5b6-7eb6fcb87a04 req-d90c53db-faba-4ca4-a7e9-65ef23d75c7b service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091749 Jun 29 08:03:46.946576 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 41/85] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jun 29 08:03:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 29 08:03:47.143817 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-16f86958-2347-49ae-8324-b1d1931fa159 tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:03:47.144464 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-16f86958-2347-49ae-8324-b1d1931fa159 tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] [instance: b4774888-237c-41c5-8c79-7a6e34d17d70] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:03:47.153115 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-16f86958-2347-49ae-8324-b1d1931fa159 tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:03:47.154359 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-16f86958-2347-49ae-8324-b1d1931fa159 tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:03:47.155351 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-16f86958-2347-49ae-8324-b1d1931fa159 tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:03:47.156102 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-16f86958-2347-49ae-8324-b1d1931fa159 tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:03:47.284046 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-b2e25ab5-de2b-4f1d-879c-2c6f6028a880 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:03:47.284935 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-b2e25ab5-de2b-4f1d-879c-2c6f6028a880 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] [instance: f99567d1-cadf-40c5-b1dc-f86739b2b16c] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:03:47.301821 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-b2e25ab5-de2b-4f1d-879c-2c6f6028a880 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:03:47.302282 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-b2e25ab5-de2b-4f1d-879c-2c6f6028a880 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:03:47.303097 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-b2e25ab5-de2b-4f1d-879c-2c6f6028a880 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:03:47.308008 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-b2e25ab5-de2b-4f1d-879c-2c6f6028a880 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:03:47.488539 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-16f86958-2347-49ae-8324-b1d1931fa159 tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0800a22846504b0d9c49e1520a69e45b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46c6cdc3217456dba6eda8ff23e9f3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:03:47.504682 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-16f86958-2347-49ae-8324-b1d1931fa159 tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] 10.222.0.43 "GET /compute/v2.1/servers/b4774888-237c-41c5-8c79-7a6e34d17d70" status: 200 len: 1314 microversion: 2.1 time: 0.365277 Jun 29 08:03:47.506006 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 45/86] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:03:47 2022] GET /compute/v2.1/servers/b4774888-237c-41c5-8c79-7a6e34d17d70 => generated 1314 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:03:47.544195 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-b2e25ab5-de2b-4f1d-879c-2c6f6028a880 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:03:47.560376 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-b2e25ab5-de2b-4f1d-879c-2c6f6028a880 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:03:47.563572 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-b2e25ab5-de2b-4f1d-879c-2c6f6028a880 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:03:47.566019 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-b2e25ab5-de2b-4f1d-879c-2c6f6028a880 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] 10.222.0.43 "GET /compute/v2.1/servers/f99567d1-cadf-40c5-b1dc-f86739b2b16c" status: 200 len: 1408 microversion: 2.20 time: 0.287918 Jun 29 08:03:47.567416 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 42/87] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 29 08:03:47 2022] GET /compute/v2.1/servers/f99567d1-cadf-40c5-b1dc-f86739b2b16c => generated 1408 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 29 08:03:47.679611 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-c56ef04a-2bcf-4934-b256-534c91494057 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:03:47.681221 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-c56ef04a-2bcf-4934-b256-534c91494057 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] [instance: 4f1bbb36-8695-4b09-9f25-bfc92ad06a86] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:03:47.697582 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c56ef04a-2bcf-4934-b256-534c91494057 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:03:47.698391 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c56ef04a-2bcf-4934-b256-534c91494057 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:03:47.700922 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c56ef04a-2bcf-4934-b256-534c91494057 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:03:47.701845 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c56ef04a-2bcf-4934-b256-534c91494057 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:03:47.952507 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-8a5ad9f5-fc09-458b-b14e-7cdb91690bed tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:03:47.953208 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-8a5ad9f5-fc09-458b-b14e-7cdb91690bed tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] [instance: d5d97f9b-3f4a-4a5e-89e8-98d55412fe71] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:03:47.962992 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-8a5ad9f5-fc09-458b-b14e-7cdb91690bed tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:03:47.964278 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-8a5ad9f5-fc09-458b-b14e-7cdb91690bed tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:03:47.965487 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-8a5ad9f5-fc09-458b-b14e-7cdb91690bed tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:03:47.966170 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-8a5ad9f5-fc09-458b-b14e-7cdb91690bed tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:03:48.001119 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-c56ef04a-2bcf-4934-b256-534c91494057 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4af4eedee24897be2e702ef51873b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab693125979f4bb7b7b3c94061610fe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:03:48.011091 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-c56ef04a-2bcf-4934-b256-534c91494057 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] 10.222.0.43 "GET /compute/v2.1/servers/4f1bbb36-8695-4b09-9f25-bfc92ad06a86" status: 200 len: 1320 microversion: 2.1 time: 0.342102 Jun 29 08:03:48.012424 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 46/88] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:03:47 2022] GET /compute/v2.1/servers/4f1bbb36-8695-4b09-9f25-bfc92ad06a86 => generated 1320 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:03:48.535688 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-8a5ad9f5-fc09-458b-b14e-7cdb91690bed tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c70c44993ab240b1a5231df4c9d550c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e0c37d941434569b3dbd07e22125210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:03:48.542502 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-8469f634-3d5c-4bbd-91eb-cf5e6e5ea070 tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:03:48.543154 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-8469f634-3d5c-4bbd-91eb-cf5e6e5ea070 tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] [instance: b4774888-237c-41c5-8c79-7a6e34d17d70] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:03:48.570555 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-8469f634-3d5c-4bbd-91eb-cf5e6e5ea070 tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:03:48.571029 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-8469f634-3d5c-4bbd-91eb-cf5e6e5ea070 tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:03:48.571974 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-8469f634-3d5c-4bbd-91eb-cf5e6e5ea070 tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:03:48.572427 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-8469f634-3d5c-4bbd-91eb-cf5e6e5ea070 tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:03:48.573824 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-8a5ad9f5-fc09-458b-b14e-7cdb91690bed tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] 10.222.0.43 "GET /compute/v2.1/servers/d5d97f9b-3f4a-4a5e-89e8-98d55412fe71" status: 200 len: 1362 microversion: 2.1 time: 0.625212 Jun 29 08:03:48.589200 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 43/89] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:03:47 2022] GET /compute/v2.1/servers/d5d97f9b-3f4a-4a5e-89e8-98d55412fe71 => generated 1362 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:03:48.620957 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-d014aec6-3467-4304-91c1-c2d00089c17e tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:03:48.622086 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-d014aec6-3467-4304-91c1-c2d00089c17e tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] [instance: f99567d1-cadf-40c5-b1dc-f86739b2b16c] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:03:48.665809 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-d014aec6-3467-4304-91c1-c2d00089c17e tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:03:48.666424 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-d014aec6-3467-4304-91c1-c2d00089c17e tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:03:48.668320 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-d014aec6-3467-4304-91c1-c2d00089c17e tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:03:48.669049 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-d014aec6-3467-4304-91c1-c2d00089c17e tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:03:48.868063 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-8469f634-3d5c-4bbd-91eb-cf5e6e5ea070 tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0800a22846504b0d9c49e1520a69e45b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46c6cdc3217456dba6eda8ff23e9f3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:03:48.883521 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-8469f634-3d5c-4bbd-91eb-cf5e6e5ea070 tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] 10.222.0.43 "GET /compute/v2.1/servers/b4774888-237c-41c5-8c79-7a6e34d17d70" status: 200 len: 1314 microversion: 2.1 time: 0.346640 Jun 29 08:03:48.885689 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 47/90] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:03:48 2022] GET /compute/v2.1/servers/b4774888-237c-41c5-8c79-7a6e34d17d70 => generated 1314 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:03:48.981464 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-d014aec6-3467-4304-91c1-c2d00089c17e tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:03:49.000551 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [req-a9809090-b065-4fc0-8505-f3df715bf976 req-8906cfdf-f343-4b17-9536-5b7a0fc96e3a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f99567d1-cadf-40c5-b1dc-f86739b2b16c", "name": "network-vif-plugged", "status": "completed", "tag": "dfb8e71b-41e2-4d03-8de7-4f7323f5b53b"}]} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:03:49.019576 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-d014aec6-3467-4304-91c1-c2d00089c17e tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:03:49.021549 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-d014aec6-3467-4304-91c1-c2d00089c17e tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:03:49.025488 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-a9809090-b065-4fc0-8505-f3df715bf976 req-8906cfdf-f343-4b17-9536-5b7a0fc96e3a service nova] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:03:49.029902 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-d014aec6-3467-4304-91c1-c2d00089c17e tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] 10.222.0.43 "GET /compute/v2.1/servers/f99567d1-cadf-40c5-b1dc-f86739b2b16c" status: 200 len: 1408 microversion: 2.20 time: 0.437805 Jun 29 08:03:49.032740 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 44/91] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 29 08:03:48 2022] GET /compute/v2.1/servers/f99567d1-cadf-40c5-b1dc-f86739b2b16c => generated 1408 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:03:49.049101 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-9b8d86b3-44be-4f73-b4c3-7dd47413baf7 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:03:49.049378 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-a9809090-b065-4fc0-8505-f3df715bf976 req-8906cfdf-f343-4b17-9536-5b7a0fc96e3a service nova] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:03:49.050070 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-9b8d86b3-44be-4f73-b4c3-7dd47413baf7 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] [instance: 4f1bbb36-8695-4b09-9f25-bfc92ad06a86] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:03:49.058342 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-9b8d86b3-44be-4f73-b4c3-7dd47413baf7 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:03:49.058787 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-9b8d86b3-44be-4f73-b4c3-7dd47413baf7 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:03:49.059981 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-9b8d86b3-44be-4f73-b4c3-7dd47413baf7 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:03:49.060580 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-9b8d86b3-44be-4f73-b4c3-7dd47413baf7 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:03:49.117377 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.compute.server_external_events [req-a9809090-b065-4fc0-8505-f3df715bf976 req-8906cfdf-f343-4b17-9536-5b7a0fc96e3a service nova] Creating event network-vif-plugged:dfb8e71b-41e2-4d03-8de7-4f7323f5b53b for instance f99567d1-cadf-40c5-b1dc-f86739b2b16c on hv-cinder-76810 Jun 29 08:03:49.138915 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [req-a9809090-b065-4fc0-8505-f3df715bf976 req-8906cfdf-f343-4b17-9536-5b7a0fc96e3a service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.139276 Jun 29 08:03:49.143822 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 48/92] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jun 29 08:03:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 29 08:03:49.265432 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-9b8d86b3-44be-4f73-b4c3-7dd47413baf7 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4af4eedee24897be2e702ef51873b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab693125979f4bb7b7b3c94061610fe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:03:49.275008 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-9b8d86b3-44be-4f73-b4c3-7dd47413baf7 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] 10.222.0.43 "GET /compute/v2.1/servers/4f1bbb36-8695-4b09-9f25-bfc92ad06a86" status: 200 len: 1513 microversion: 2.1 time: 0.230255 Jun 29 08:03:49.275955 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 45/93] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:03:49 2022] GET /compute/v2.1/servers/4f1bbb36-8695-4b09-9f25-bfc92ad06a86 => generated 1513 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:03:49.297051 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-07c89843-6d8c-43c7-aa5c-458d21fd5f60 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:03:49.298457 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-07c89843-6d8c-43c7-aa5c-458d21fd5f60 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] [instance: 4f1bbb36-8695-4b09-9f25-bfc92ad06a86] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:03:49.311703 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-07c89843-6d8c-43c7-aa5c-458d21fd5f60 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:03:49.311703 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-07c89843-6d8c-43c7-aa5c-458d21fd5f60 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:03:49.311703 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-07c89843-6d8c-43c7-aa5c-458d21fd5f60 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:03:49.312157 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-07c89843-6d8c-43c7-aa5c-458d21fd5f60 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:03:49.400473 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.objects.instance [None req-07c89843-6d8c-43c7-aa5c-458d21fd5f60 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lazy-loading 'flavor' on Instance uuid 4f1bbb36-8695-4b09-9f25-bfc92ad06a86 {{(pid=117889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 29 08:03:49.619887 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-665c7f92-561a-48ec-acfb-2f2a89696ff0 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:03:49.622857 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-665c7f92-561a-48ec-acfb-2f2a89696ff0 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] [instance: d5d97f9b-3f4a-4a5e-89e8-98d55412fe71] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:03:49.650151 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-07c89843-6d8c-43c7-aa5c-458d21fd5f60 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] 10.222.0.43 "POST /compute/v2.1/servers/4f1bbb36-8695-4b09-9f25-bfc92ad06a86/action" status: 200 len: 32 microversion: 2.1 time: 0.359569 Jun 29 08:03:49.653707 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 49/94] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Jun 29 08:03:49 2022] POST /compute/v2.1/servers/4f1bbb36-8695-4b09-9f25-bfc92ad06a86/action => generated 32 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 29 08:03:49.663449 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-665c7f92-561a-48ec-acfb-2f2a89696ff0 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:03:49.665597 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-665c7f92-561a-48ec-acfb-2f2a89696ff0 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:03:49.669400 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-31a91085-4ddd-49e3-a8e4-2ba21ddfb927 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:03:49.672612 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-31a91085-4ddd-49e3-a8e4-2ba21ddfb927 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] [instance: 4f1bbb36-8695-4b09-9f25-bfc92ad06a86] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:03:49.686401 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-665c7f92-561a-48ec-acfb-2f2a89696ff0 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:03:49.688239 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-665c7f92-561a-48ec-acfb-2f2a89696ff0 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:03:49.690920 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-31a91085-4ddd-49e3-a8e4-2ba21ddfb927 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:03:49.696893 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-31a91085-4ddd-49e3-a8e4-2ba21ddfb927 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:03:49.698441 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-31a91085-4ddd-49e3-a8e4-2ba21ddfb927 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:03:49.699311 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-31a91085-4ddd-49e3-a8e4-2ba21ddfb927 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:03:50.024341 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-31a91085-4ddd-49e3-a8e4-2ba21ddfb927 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4af4eedee24897be2e702ef51873b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab693125979f4bb7b7b3c94061610fe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:03:50.039247 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-31a91085-4ddd-49e3-a8e4-2ba21ddfb927 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] 10.222.0.43 "GET /compute/v2.1/servers/4f1bbb36-8695-4b09-9f25-bfc92ad06a86" status: 200 len: 1519 microversion: 2.1 time: 0.372662 Jun 29 08:03:50.051745 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 50/95] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:03:49 2022] GET /compute/v2.1/servers/4f1bbb36-8695-4b09-9f25-bfc92ad06a86 => generated 1519 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 08:03:50.123574 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-cb954251-5aab-4402-8cd6-323145889d24 tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:03:50.134833 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-cb954251-5aab-4402-8cd6-323145889d24 tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] [instance: b4774888-237c-41c5-8c79-7a6e34d17d70] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:03:50.178624 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-cb954251-5aab-4402-8cd6-323145889d24 tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:03:50.182415 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-cb954251-5aab-4402-8cd6-323145889d24 tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:03:50.190797 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-cb954251-5aab-4402-8cd6-323145889d24 tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:03:50.192550 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-cb954251-5aab-4402-8cd6-323145889d24 tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:03:50.677675 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-665c7f92-561a-48ec-acfb-2f2a89696ff0 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c70c44993ab240b1a5231df4c9d550c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e0c37d941434569b3dbd07e22125210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:03:50.695034 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-665c7f92-561a-48ec-acfb-2f2a89696ff0 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] 10.222.0.43 "GET /compute/v2.1/servers/d5d97f9b-3f4a-4a5e-89e8-98d55412fe71" status: 200 len: 1362 microversion: 2.1 time: 1.089319 Jun 29 08:03:50.697508 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 46/96] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:03:49 2022] GET /compute/v2.1/servers/d5d97f9b-3f4a-4a5e-89e8-98d55412fe71 => generated 1362 bytes in 1093 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 08:03:50.706177 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-b439cf86-6217-4ab4-97da-da971566836d tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:03:50.707772 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-b439cf86-6217-4ab4-97da-da971566836d tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] [instance: f99567d1-cadf-40c5-b1dc-f86739b2b16c] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:03:50.720520 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-b439cf86-6217-4ab4-97da-da971566836d tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:03:50.721702 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-b439cf86-6217-4ab4-97da-da971566836d tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:03:50.723522 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-b439cf86-6217-4ab4-97da-da971566836d tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:03:50.725128 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-b439cf86-6217-4ab4-97da-da971566836d tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:03:50.931381 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-cb954251-5aab-4402-8cd6-323145889d24 tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0800a22846504b0d9c49e1520a69e45b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46c6cdc3217456dba6eda8ff23e9f3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:03:50.956633 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-cb954251-5aab-4402-8cd6-323145889d24 tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] 10.222.0.43 "GET /compute/v2.1/servers/b4774888-237c-41c5-8c79-7a6e34d17d70" status: 200 len: 1314 microversion: 2.1 time: 0.860750 Jun 29 08:03:50.962183 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 51/97] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:03:50 2022] GET /compute/v2.1/servers/b4774888-237c-41c5-8c79-7a6e34d17d70 => generated 1314 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:03:51.081105 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-149c3308-c34a-4c47-b56a-a93e08a535b6 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:03:51.082169 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-149c3308-c34a-4c47-b56a-a93e08a535b6 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] [instance: 4f1bbb36-8695-4b09-9f25-bfc92ad06a86] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:03:51.104424 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-149c3308-c34a-4c47-b56a-a93e08a535b6 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:03:51.105309 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-149c3308-c34a-4c47-b56a-a93e08a535b6 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:03:51.106268 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-149c3308-c34a-4c47-b56a-a93e08a535b6 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:03:51.106788 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-149c3308-c34a-4c47-b56a-a93e08a535b6 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:03:51.132934 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:03:51.360520 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-b439cf86-6217-4ab4-97da-da971566836d tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:03:51.385467 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-b439cf86-6217-4ab4-97da-da971566836d tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:03:51.387266 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-b439cf86-6217-4ab4-97da-da971566836d tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:03:51.388649 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-b439cf86-6217-4ab4-97da-da971566836d tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] 10.222.0.43 "GET /compute/v2.1/servers/f99567d1-cadf-40c5-b1dc-f86739b2b16c" status: 200 len: 1408 microversion: 2.20 time: 0.689454 Jun 29 08:03:51.401031 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 47/98] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 29 08:03:50 2022] GET /compute/v2.1/servers/f99567d1-cadf-40c5-b1dc-f86739b2b16c => generated 1408 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:03:51.401358 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-149c3308-c34a-4c47-b56a-a93e08a535b6 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4af4eedee24897be2e702ef51873b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab693125979f4bb7b7b3c94061610fe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:03:51.415858 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-149c3308-c34a-4c47-b56a-a93e08a535b6 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] 10.222.0.43 "GET /compute/v2.1/servers/4f1bbb36-8695-4b09-9f25-bfc92ad06a86" status: 200 len: 1519 microversion: 2.1 time: 0.341349 Jun 29 08:03:51.417552 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 52/99] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:03:51 2022] GET /compute/v2.1/servers/4f1bbb36-8695-4b09-9f25-bfc92ad06a86 => generated 1519 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 08:03:51.718925 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-df27af5b-1184-4d02-80c5-7f5d1f529370 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:03:51.719787 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-df27af5b-1184-4d02-80c5-7f5d1f529370 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] [instance: d5d97f9b-3f4a-4a5e-89e8-98d55412fe71] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:03:51.732135 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-df27af5b-1184-4d02-80c5-7f5d1f529370 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:03:51.732652 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-df27af5b-1184-4d02-80c5-7f5d1f529370 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:03:51.739768 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-df27af5b-1184-4d02-80c5-7f5d1f529370 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:03:51.740382 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-df27af5b-1184-4d02-80c5-7f5d1f529370 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:03:51.980548 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-ed719d4c-f4b0-4edc-8cc4-0f68d3dfa66a tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:03:51.984364 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-ed719d4c-f4b0-4edc-8cc4-0f68d3dfa66a tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] [instance: b4774888-237c-41c5-8c79-7a6e34d17d70] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:03:52.018486 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ed719d4c-f4b0-4edc-8cc4-0f68d3dfa66a tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:03:52.019337 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ed719d4c-f4b0-4edc-8cc4-0f68d3dfa66a tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:03:52.021015 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ed719d4c-f4b0-4edc-8cc4-0f68d3dfa66a tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:03:52.027636 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ed719d4c-f4b0-4edc-8cc4-0f68d3dfa66a tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:03:52.157452 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-df27af5b-1184-4d02-80c5-7f5d1f529370 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c70c44993ab240b1a5231df4c9d550c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e0c37d941434569b3dbd07e22125210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:03:52.187442 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-df27af5b-1184-4d02-80c5-7f5d1f529370 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] 10.222.0.43 "GET /compute/v2.1/servers/d5d97f9b-3f4a-4a5e-89e8-98d55412fe71" status: 200 len: 1548 microversion: 2.1 time: 0.475926 Jun 29 08:03:52.189890 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 48/100] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:03:51 2022] GET /compute/v2.1/servers/d5d97f9b-3f4a-4a5e-89e8-98d55412fe71 => generated 1548 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:03:52.220609 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-9bbff40c-807e-4008-8bd2-b394ce9dd5e1 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:03:52.222327 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-9bbff40c-807e-4008-8bd2-b394ce9dd5e1 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] [instance: d5d97f9b-3f4a-4a5e-89e8-98d55412fe71] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:03:52.238182 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-9bbff40c-807e-4008-8bd2-b394ce9dd5e1 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:03:52.239712 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-9bbff40c-807e-4008-8bd2-b394ce9dd5e1 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:03:52.241849 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-9bbff40c-807e-4008-8bd2-b394ce9dd5e1 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:03:52.243362 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-9bbff40c-807e-4008-8bd2-b394ce9dd5e1 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:03:52.529100 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-9bbff40c-807e-4008-8bd2-b394ce9dd5e1 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] 10.222.0.43 "GET /compute/v2.1/servers/d5d97f9b-3f4a-4a5e-89e8-98d55412fe71/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.319271 Jun 29 08:03:52.530459 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 49/101] 10.222.0.43 () {58 vars in 1274 bytes} [Wed Jun 29 08:03:52 2022] GET /compute/v2.1/servers/d5d97f9b-3f4a-4a5e-89e8-98d55412fe71/os-interface => generated 285 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:03:52.545858 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-9debeaef-e1c0-46cf-a036-25a0673410f7 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:03:52.547210 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-9debeaef-e1c0-46cf-a036-25a0673410f7 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] [instance: f99567d1-cadf-40c5-b1dc-f86739b2b16c] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:03:52.568735 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG dbcounter [-] [117890] Writing DB stats nova_api:SELECT=68 {{(pid=117890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:03:52.576793 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-9debeaef-e1c0-46cf-a036-25a0673410f7 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:03:52.579674 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-9debeaef-e1c0-46cf-a036-25a0673410f7 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:03:52.581305 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-9debeaef-e1c0-46cf-a036-25a0673410f7 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:03:52.581489 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-ed719d4c-f4b0-4edc-8cc4-0f68d3dfa66a tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0800a22846504b0d9c49e1520a69e45b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46c6cdc3217456dba6eda8ff23e9f3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:03:52.588321 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-9debeaef-e1c0-46cf-a036-25a0673410f7 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:03:52.593694 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-ed719d4c-f4b0-4edc-8cc4-0f68d3dfa66a tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] 10.222.0.43 "GET /compute/v2.1/servers/b4774888-237c-41c5-8c79-7a6e34d17d70" status: 200 len: 1314 microversion: 2.1 time: 0.621655 Jun 29 08:03:52.609358 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 53/102] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:03:51 2022] GET /compute/v2.1/servers/b4774888-237c-41c5-8c79-7a6e34d17d70 => generated 1314 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:03:52.623350 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-4148d54c-bfac-442d-bf0d-b35774472fd2 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:03:52.623994 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-4148d54c-bfac-442d-bf0d-b35774472fd2 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] [instance: 4f1bbb36-8695-4b09-9f25-bfc92ad06a86] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:03:52.638034 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-4148d54c-bfac-442d-bf0d-b35774472fd2 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:03:52.639919 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-4148d54c-bfac-442d-bf0d-b35774472fd2 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:03:52.640836 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-4148d54c-bfac-442d-bf0d-b35774472fd2 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:03:52.641352 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-4148d54c-bfac-442d-bf0d-b35774472fd2 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:03:52.919341 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-4148d54c-bfac-442d-bf0d-b35774472fd2 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4af4eedee24897be2e702ef51873b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab693125979f4bb7b7b3c94061610fe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:03:52.934858 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-4148d54c-bfac-442d-bf0d-b35774472fd2 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] 10.222.0.43 "GET /compute/v2.1/servers/4f1bbb36-8695-4b09-9f25-bfc92ad06a86" status: 200 len: 1519 microversion: 2.1 time: 0.322913 Jun 29 08:03:52.936080 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 54/103] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:03:52 2022] GET /compute/v2.1/servers/4f1bbb36-8695-4b09-9f25-bfc92ad06a86 => generated 1519 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:03:53.367204 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-9debeaef-e1c0-46cf-a036-25a0673410f7 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:03:53.382742 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-9debeaef-e1c0-46cf-a036-25a0673410f7 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:03:53.389655 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-9debeaef-e1c0-46cf-a036-25a0673410f7 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:03:53.395229 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-9debeaef-e1c0-46cf-a036-25a0673410f7 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] 10.222.0.43 "GET /compute/v2.1/servers/f99567d1-cadf-40c5-b1dc-f86739b2b16c" status: 200 len: 1408 microversion: 2.20 time: 0.862675 Jun 29 08:03:53.396389 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 50/104] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 29 08:03:52 2022] GET /compute/v2.1/servers/f99567d1-cadf-40c5-b1dc-f86739b2b16c => generated 1408 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:03:53.620050 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-684a6c44-44a4-4e2f-badc-3d6607ed0ebc tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:03:53.624272 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-684a6c44-44a4-4e2f-badc-3d6607ed0ebc tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] [instance: b4774888-237c-41c5-8c79-7a6e34d17d70] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:03:53.656899 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-684a6c44-44a4-4e2f-badc-3d6607ed0ebc tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:03:53.659479 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-684a6c44-44a4-4e2f-badc-3d6607ed0ebc tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:03:53.667466 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-684a6c44-44a4-4e2f-badc-3d6607ed0ebc tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:03:53.668181 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-684a6c44-44a4-4e2f-badc-3d6607ed0ebc tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:03:53.971381 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-2b1906a9-8611-4378-9c34-c30e182f4852 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:03:53.973570 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-2b1906a9-8611-4378-9c34-c30e182f4852 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] [instance: 4f1bbb36-8695-4b09-9f25-bfc92ad06a86] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:03:54.002510 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-2b1906a9-8611-4378-9c34-c30e182f4852 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:03:54.005401 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-2b1906a9-8611-4378-9c34-c30e182f4852 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:03:54.015547 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-2b1906a9-8611-4378-9c34-c30e182f4852 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:03:54.017208 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-2b1906a9-8611-4378-9c34-c30e182f4852 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:03:54.206647 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-684a6c44-44a4-4e2f-badc-3d6607ed0ebc tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0800a22846504b0d9c49e1520a69e45b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46c6cdc3217456dba6eda8ff23e9f3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:03:54.223547 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-684a6c44-44a4-4e2f-badc-3d6607ed0ebc tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] 10.222.0.43 "GET /compute/v2.1/servers/b4774888-237c-41c5-8c79-7a6e34d17d70" status: 200 len: 1502 microversion: 2.1 time: 0.609069 Jun 29 08:03:54.224849 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 55/105] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:03:53 2022] GET /compute/v2.1/servers/b4774888-237c-41c5-8c79-7a6e34d17d70 => generated 1502 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:03:54.437218 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-80638bb7-39f9-43ba-a9fe-e3e05f897141 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:03:54.440525 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-80638bb7-39f9-43ba-a9fe-e3e05f897141 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] [instance: f99567d1-cadf-40c5-b1dc-f86739b2b16c] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:03:54.478095 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-80638bb7-39f9-43ba-a9fe-e3e05f897141 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:03:54.482769 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-80638bb7-39f9-43ba-a9fe-e3e05f897141 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:03:54.488774 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-80638bb7-39f9-43ba-a9fe-e3e05f897141 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:03:54.492029 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-80638bb7-39f9-43ba-a9fe-e3e05f897141 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:03:54.897772 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-2b1906a9-8611-4378-9c34-c30e182f4852 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4af4eedee24897be2e702ef51873b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab693125979f4bb7b7b3c94061610fe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:03:54.905397 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG dbcounter [-] [117890] Writing DB stats nova_cell1:SELECT=100 {{(pid=117890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:03:54.943992 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-2b1906a9-8611-4378-9c34-c30e182f4852 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] 10.222.0.43 "GET /compute/v2.1/servers/4f1bbb36-8695-4b09-9f25-bfc92ad06a86" status: 200 len: 1519 microversion: 2.1 time: 0.975198 Jun 29 08:03:54.948291 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 51/106] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:03:53 2022] GET /compute/v2.1/servers/4f1bbb36-8695-4b09-9f25-bfc92ad06a86 => generated 1519 bytes in 989 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 08:03:55.024838 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-80638bb7-39f9-43ba-a9fe-e3e05f897141 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:03:55.055466 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-80638bb7-39f9-43ba-a9fe-e3e05f897141 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:03:55.059811 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-80638bb7-39f9-43ba-a9fe-e3e05f897141 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:03:55.062958 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-80638bb7-39f9-43ba-a9fe-e3e05f897141 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] 10.222.0.43 "GET /compute/v2.1/servers/f99567d1-cadf-40c5-b1dc-f86739b2b16c" status: 200 len: 1600 microversion: 2.20 time: 0.637948 Jun 29 08:03:55.065064 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 56/107] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 29 08:03:54 2022] GET /compute/v2.1/servers/f99567d1-cadf-40c5-b1dc-f86739b2b16c => generated 1600 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 29 08:03:55.093838 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-bd450590-0d1f-493f-931b-a735aeb83aba tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:03:55.095980 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-bd450590-0d1f-493f-931b-a735aeb83aba tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] [instance: f99567d1-cadf-40c5-b1dc-f86739b2b16c] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:03:55.109500 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-bd450590-0d1f-493f-931b-a735aeb83aba tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:03:55.111577 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-bd450590-0d1f-493f-931b-a735aeb83aba tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:03:55.115290 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-bd450590-0d1f-493f-931b-a735aeb83aba tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:03:55.118830 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-bd450590-0d1f-493f-931b-a735aeb83aba tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:03:55.679344 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-bd450590-0d1f-493f-931b-a735aeb83aba tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] 10.222.0.43 "GET /compute/v2.1/servers/f99567d1-cadf-40c5-b1dc-f86739b2b16c/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.596587 Jun 29 08:03:55.680460 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 52/108] 10.222.0.43 () {60 vars in 1315 bytes} [Wed Jun 29 08:03:55 2022] GET /compute/v2.1/servers/f99567d1-cadf-40c5-b1dc-f86739b2b16c/os-interface => generated 284 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 29 08:03:55.965463 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-6f19a335-1658-43ef-a4fd-3e462b0376bb tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:03:55.966499 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-6f19a335-1658-43ef-a4fd-3e462b0376bb tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] [instance: 4f1bbb36-8695-4b09-9f25-bfc92ad06a86] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:03:55.990004 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-6f19a335-1658-43ef-a4fd-3e462b0376bb tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:03:55.993108 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-6f19a335-1658-43ef-a4fd-3e462b0376bb tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:03:56.002283 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-6f19a335-1658-43ef-a4fd-3e462b0376bb tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:03:56.003732 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-6f19a335-1658-43ef-a4fd-3e462b0376bb tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:03:56.336269 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-6f19a335-1658-43ef-a4fd-3e462b0376bb tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4af4eedee24897be2e702ef51873b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab693125979f4bb7b7b3c94061610fe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:03:56.343301 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-b1175b72-2f18-4873-a983-39c1cf98a80b tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cad4ad41-9b93-40f2-adea-1ecae69149cb"}} {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:03:56.345884 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-6f19a335-1658-43ef-a4fd-3e462b0376bb tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] 10.222.0.43 "GET /compute/v2.1/servers/4f1bbb36-8695-4b09-9f25-bfc92ad06a86" status: 200 len: 1519 microversion: 2.1 time: 0.387309 Jun 29 08:03:56.351959 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-b1175b72-2f18-4873-a983-39c1cf98a80b tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] [instance: b4774888-237c-41c5-8c79-7a6e34d17d70] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:03:56.352812 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 57/109] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:03:55 2022] GET /compute/v2.1/servers/4f1bbb36-8695-4b09-9f25-bfc92ad06a86 => generated 1519 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:03:56.390863 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-b1175b72-2f18-4873-a983-39c1cf98a80b tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:03:56.399919 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-b1175b72-2f18-4873-a983-39c1cf98a80b tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:03:56.406950 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-b1175b72-2f18-4873-a983-39c1cf98a80b tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:03:56.410258 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-b1175b72-2f18-4873-a983-39c1cf98a80b tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:03:57.240149 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [req-677c9c97-b7eb-4255-b554-6531d6b8f19c req-d879b1fa-9662-4187-8f98-a276c70bdd5c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d5d97f9b-3f4a-4a5e-89e8-98d55412fe71", "tag": "b93d914e-7134-4247-b5f0-de80f217a1e0"}]} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:03:57.243252 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-b1175b72-2f18-4873-a983-39c1cf98a80b tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] 10.222.0.43 "POST /compute/v2.1/servers/b4774888-237c-41c5-8c79-7a6e34d17d70/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.917032 Jun 29 08:03:57.244220 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 53/110] 10.222.0.43 () {60 vars in 1322 bytes} [Wed Jun 29 08:03:56 2022] POST /compute/v2.1/servers/b4774888-237c-41c5-8c79-7a6e34d17d70/os-volume_attachments => generated 194 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:03:57.259138 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-677c9c97-b7eb-4255-b554-6531d6b8f19c req-d879b1fa-9662-4187-8f98-a276c70bdd5c service nova] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:03:57.259595 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-677c9c97-b7eb-4255-b554-6531d6b8f19c req-d879b1fa-9662-4187-8f98-a276c70bdd5c service nova] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:03:57.296653 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.compute.server_external_events [req-677c9c97-b7eb-4255-b554-6531d6b8f19c req-d879b1fa-9662-4187-8f98-a276c70bdd5c service nova] Creating event network-changed:b93d914e-7134-4247-b5f0-de80f217a1e0 for instance d5d97f9b-3f4a-4a5e-89e8-98d55412fe71 on hv-cinder-76810 Jun 29 08:03:57.312707 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [req-677c9c97-b7eb-4255-b554-6531d6b8f19c req-d879b1fa-9662-4187-8f98-a276c70bdd5c service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078949 Jun 29 08:03:57.313385 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 58/111] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jun 29 08:03:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:03:57.374627 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-7516b595-643e-4e28-9d84-e22cb1dbe4f1 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:03:57.378760 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-7516b595-643e-4e28-9d84-e22cb1dbe4f1 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] [instance: 4f1bbb36-8695-4b09-9f25-bfc92ad06a86] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:03:57.440819 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-7516b595-643e-4e28-9d84-e22cb1dbe4f1 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:03:57.441679 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-7516b595-643e-4e28-9d84-e22cb1dbe4f1 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:03:57.443030 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-7516b595-643e-4e28-9d84-e22cb1dbe4f1 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:03:57.444342 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-7516b595-643e-4e28-9d84-e22cb1dbe4f1 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:03:58.053692 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-7516b595-643e-4e28-9d84-e22cb1dbe4f1 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4af4eedee24897be2e702ef51873b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab693125979f4bb7b7b3c94061610fe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:03:58.092006 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-7516b595-643e-4e28-9d84-e22cb1dbe4f1 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] 10.222.0.43 "GET /compute/v2.1/servers/4f1bbb36-8695-4b09-9f25-bfc92ad06a86" status: 200 len: 1519 microversion: 2.1 time: 0.711039 Jun 29 08:03:58.111248 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 54/112] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:03:57 2022] GET /compute/v2.1/servers/4f1bbb36-8695-4b09-9f25-bfc92ad06a86 => generated 1519 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:03:58.838471 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [req-88906ea3-d927-466a-8532-72eec73b9e1d req-07b52318-b771-46c5-86d2-f6da8bd6db52 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f99567d1-cadf-40c5-b1dc-f86739b2b16c", "tag": "dfb8e71b-41e2-4d03-8de7-4f7323f5b53b"}]} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:03:58.852138 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_api:SELECT=82 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:03:58.857957 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-88906ea3-d927-466a-8532-72eec73b9e1d req-07b52318-b771-46c5-86d2-f6da8bd6db52 service nova] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:03:58.858648 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-88906ea3-d927-466a-8532-72eec73b9e1d req-07b52318-b771-46c5-86d2-f6da8bd6db52 service nova] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:03:58.888936 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.compute.server_external_events [req-88906ea3-d927-466a-8532-72eec73b9e1d req-07b52318-b771-46c5-86d2-f6da8bd6db52 service nova] Creating event network-changed:dfb8e71b-41e2-4d03-8de7-4f7323f5b53b for instance f99567d1-cadf-40c5-b1dc-f86739b2b16c on hv-cinder-76810 Jun 29 08:03:58.897160 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [req-88906ea3-d927-466a-8532-72eec73b9e1d req-07b52318-b771-46c5-86d2-f6da8bd6db52 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065808 Jun 29 08:03:58.897787 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 59/113] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jun 29 08:03:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Jun 29 08:03:59.118342 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-6e89cda2-9e2a-4f48-9e1a-24317ee8df04 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:03:59.118964 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-6e89cda2-9e2a-4f48-9e1a-24317ee8df04 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] [instance: 4f1bbb36-8695-4b09-9f25-bfc92ad06a86] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:03:59.134368 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-6e89cda2-9e2a-4f48-9e1a-24317ee8df04 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:03:59.134817 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-6e89cda2-9e2a-4f48-9e1a-24317ee8df04 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:03:59.135806 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-6e89cda2-9e2a-4f48-9e1a-24317ee8df04 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:03:59.136405 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-6e89cda2-9e2a-4f48-9e1a-24317ee8df04 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:03:59.829494 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-6e89cda2-9e2a-4f48-9e1a-24317ee8df04 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4af4eedee24897be2e702ef51873b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab693125979f4bb7b7b3c94061610fe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:03:59.839594 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-6e89cda2-9e2a-4f48-9e1a-24317ee8df04 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] 10.222.0.43 "GET /compute/v2.1/servers/4f1bbb36-8695-4b09-9f25-bfc92ad06a86" status: 200 len: 1519 microversion: 2.1 time: 0.725212 Jun 29 08:03:59.840938 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 55/114] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:03:59 2022] GET /compute/v2.1/servers/4f1bbb36-8695-4b09-9f25-bfc92ad06a86 => generated 1519 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 08:04:00.889924 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-8c55fc2c-84e3-4b4b-84c5-775479cd198b tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:04:00.894874 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-8c55fc2c-84e3-4b4b-84c5-775479cd198b tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] [instance: 4f1bbb36-8695-4b09-9f25-bfc92ad06a86] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:04:00.919520 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-8c55fc2c-84e3-4b4b-84c5-775479cd198b tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:04:00.920288 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-8c55fc2c-84e3-4b4b-84c5-775479cd198b tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:04:00.926706 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-8c55fc2c-84e3-4b4b-84c5-775479cd198b tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:04:00.927666 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-8c55fc2c-84e3-4b4b-84c5-775479cd198b tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:04:01.247162 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-8c55fc2c-84e3-4b4b-84c5-775479cd198b tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4af4eedee24897be2e702ef51873b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab693125979f4bb7b7b3c94061610fe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:04:01.258522 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-8c55fc2c-84e3-4b4b-84c5-775479cd198b tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] 10.222.0.43 "GET /compute/v2.1/servers/4f1bbb36-8695-4b09-9f25-bfc92ad06a86" status: 200 len: 1519 microversion: 2.1 time: 0.391208 Jun 29 08:04:01.259646 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 60/115] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:04:00 2022] GET /compute/v2.1/servers/4f1bbb36-8695-4b09-9f25-bfc92ad06a86 => generated 1519 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:04:02.294464 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-9a23c19e-2cfa-47fd-bafc-3c19f8c63627 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:04:02.298898 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-9a23c19e-2cfa-47fd-bafc-3c19f8c63627 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] [instance: 4f1bbb36-8695-4b09-9f25-bfc92ad06a86] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:04:02.330259 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-9a23c19e-2cfa-47fd-bafc-3c19f8c63627 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:04:02.331097 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-9a23c19e-2cfa-47fd-bafc-3c19f8c63627 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:04:02.340789 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-9a23c19e-2cfa-47fd-bafc-3c19f8c63627 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:04:02.341742 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-9a23c19e-2cfa-47fd-bafc-3c19f8c63627 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:04:02.759141 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-9a23c19e-2cfa-47fd-bafc-3c19f8c63627 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4af4eedee24897be2e702ef51873b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab693125979f4bb7b7b3c94061610fe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:04:02.776818 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-9a23c19e-2cfa-47fd-bafc-3c19f8c63627 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] 10.222.0.43 "GET /compute/v2.1/servers/4f1bbb36-8695-4b09-9f25-bfc92ad06a86" status: 200 len: 1519 microversion: 2.1 time: 0.489961 Jun 29 08:04:02.779197 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 56/116] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:04:02 2022] GET /compute/v2.1/servers/4f1bbb36-8695-4b09-9f25-bfc92ad06a86 => generated 1519 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:04:03.798506 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-ee6b3f83-1b11-4509-9ee4-bf1522a00f79 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:04:03.799720 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-ee6b3f83-1b11-4509-9ee4-bf1522a00f79 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] [instance: 4f1bbb36-8695-4b09-9f25-bfc92ad06a86] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:04:03.811074 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ee6b3f83-1b11-4509-9ee4-bf1522a00f79 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:04:03.811758 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ee6b3f83-1b11-4509-9ee4-bf1522a00f79 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:04:03.812737 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ee6b3f83-1b11-4509-9ee4-bf1522a00f79 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:04:03.813391 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ee6b3f83-1b11-4509-9ee4-bf1522a00f79 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:04:04.031395 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-ee6b3f83-1b11-4509-9ee4-bf1522a00f79 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4af4eedee24897be2e702ef51873b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab693125979f4bb7b7b3c94061610fe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:04:04.041412 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-ee6b3f83-1b11-4509-9ee4-bf1522a00f79 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] 10.222.0.43 "GET /compute/v2.1/servers/4f1bbb36-8695-4b09-9f25-bfc92ad06a86" status: 200 len: 1519 microversion: 2.1 time: 0.246835 Jun 29 08:04:04.042480 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 61/117] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:04:03 2022] GET /compute/v2.1/servers/4f1bbb36-8695-4b09-9f25-bfc92ad06a86 => generated 1519 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 08:04:05.067849 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-99f7b29c-dcc1-46db-9bfb-2d869e98c19b tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:04:05.069895 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-99f7b29c-dcc1-46db-9bfb-2d869e98c19b tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] [instance: 4f1bbb36-8695-4b09-9f25-bfc92ad06a86] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:04:05.082663 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-99f7b29c-dcc1-46db-9bfb-2d869e98c19b tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:04:05.083568 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-99f7b29c-dcc1-46db-9bfb-2d869e98c19b tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:04:05.085693 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-99f7b29c-dcc1-46db-9bfb-2d869e98c19b tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:04:05.086430 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-99f7b29c-dcc1-46db-9bfb-2d869e98c19b tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:04:05.263189 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-99f7b29c-dcc1-46db-9bfb-2d869e98c19b tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4af4eedee24897be2e702ef51873b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab693125979f4bb7b7b3c94061610fe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:04:05.277266 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-99f7b29c-dcc1-46db-9bfb-2d869e98c19b tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] 10.222.0.43 "GET /compute/v2.1/servers/4f1bbb36-8695-4b09-9f25-bfc92ad06a86" status: 200 len: 1519 microversion: 2.1 time: 0.217159 Jun 29 08:04:05.278376 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 57/118] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:04:05 2022] GET /compute/v2.1/servers/4f1bbb36-8695-4b09-9f25-bfc92ad06a86 => generated 1519 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:04:06.296510 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-b5d56b22-e869-4df1-8ec2-10c9d0266be8 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:04:06.297207 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-b5d56b22-e869-4df1-8ec2-10c9d0266be8 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] [instance: 4f1bbb36-8695-4b09-9f25-bfc92ad06a86] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:04:06.304712 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-b5d56b22-e869-4df1-8ec2-10c9d0266be8 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:04:06.305189 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-b5d56b22-e869-4df1-8ec2-10c9d0266be8 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:04:06.305967 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-b5d56b22-e869-4df1-8ec2-10c9d0266be8 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:04:06.306436 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-b5d56b22-e869-4df1-8ec2-10c9d0266be8 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:04:06.477067 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-b5d56b22-e869-4df1-8ec2-10c9d0266be8 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4af4eedee24897be2e702ef51873b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab693125979f4bb7b7b3c94061610fe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:04:06.487676 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-b5d56b22-e869-4df1-8ec2-10c9d0266be8 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] 10.222.0.43 "GET /compute/v2.1/servers/4f1bbb36-8695-4b09-9f25-bfc92ad06a86" status: 200 len: 1519 microversion: 2.1 time: 0.193499 Jun 29 08:04:06.487676 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 62/119] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:04:06 2022] GET /compute/v2.1/servers/4f1bbb36-8695-4b09-9f25-bfc92ad06a86 => generated 1519 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:04:07.505664 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-2af0062e-4509-464e-bebc-7ff726b39911 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:04:07.508002 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-2af0062e-4509-464e-bebc-7ff726b39911 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] [instance: 4f1bbb36-8695-4b09-9f25-bfc92ad06a86] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:04:07.520332 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-2af0062e-4509-464e-bebc-7ff726b39911 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:04:07.521564 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-2af0062e-4509-464e-bebc-7ff726b39911 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:04:07.522822 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-2af0062e-4509-464e-bebc-7ff726b39911 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:04:07.523644 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-2af0062e-4509-464e-bebc-7ff726b39911 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:04:07.711275 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-2af0062e-4509-464e-bebc-7ff726b39911 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4af4eedee24897be2e702ef51873b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab693125979f4bb7b7b3c94061610fe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:04:07.720317 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-2af0062e-4509-464e-bebc-7ff726b39911 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] 10.222.0.43 "GET /compute/v2.1/servers/4f1bbb36-8695-4b09-9f25-bfc92ad06a86" status: 200 len: 1519 microversion: 2.1 time: 0.220034 Jun 29 08:04:07.721161 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 58/120] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:04:07 2022] GET /compute/v2.1/servers/4f1bbb36-8695-4b09-9f25-bfc92ad06a86 => generated 1519 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:04:08.745731 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-8f8185b7-0039-44ce-894d-7af6dfe61006 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:04:08.747312 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-8f8185b7-0039-44ce-894d-7af6dfe61006 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] [instance: 4f1bbb36-8695-4b09-9f25-bfc92ad06a86] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:04:08.758724 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-8f8185b7-0039-44ce-894d-7af6dfe61006 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:04:08.759767 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-8f8185b7-0039-44ce-894d-7af6dfe61006 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:04:08.761153 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-8f8185b7-0039-44ce-894d-7af6dfe61006 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:04:08.761962 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-8f8185b7-0039-44ce-894d-7af6dfe61006 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:04:09.004548 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-8f8185b7-0039-44ce-894d-7af6dfe61006 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4af4eedee24897be2e702ef51873b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab693125979f4bb7b7b3c94061610fe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:04:09.014151 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-8f8185b7-0039-44ce-894d-7af6dfe61006 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] 10.222.0.43 "GET /compute/v2.1/servers/4f1bbb36-8695-4b09-9f25-bfc92ad06a86" status: 200 len: 1519 microversion: 2.1 time: 0.274123 Jun 29 08:04:09.015372 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 63/121] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:04:08 2022] GET /compute/v2.1/servers/4f1bbb36-8695-4b09-9f25-bfc92ad06a86 => generated 1519 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:04:10.042070 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-b43a6cf5-b0e3-4947-8a1f-6659252e2a70 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:04:10.043188 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-b43a6cf5-b0e3-4947-8a1f-6659252e2a70 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] [instance: 4f1bbb36-8695-4b09-9f25-bfc92ad06a86] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:04:10.054808 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-b43a6cf5-b0e3-4947-8a1f-6659252e2a70 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:04:10.055530 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-b43a6cf5-b0e3-4947-8a1f-6659252e2a70 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:04:10.056814 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-b43a6cf5-b0e3-4947-8a1f-6659252e2a70 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:04:10.057522 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-b43a6cf5-b0e3-4947-8a1f-6659252e2a70 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:04:10.237425 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-b43a6cf5-b0e3-4947-8a1f-6659252e2a70 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4af4eedee24897be2e702ef51873b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab693125979f4bb7b7b3c94061610fe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:04:10.253178 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-b43a6cf5-b0e3-4947-8a1f-6659252e2a70 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] 10.222.0.43 "GET /compute/v2.1/servers/4f1bbb36-8695-4b09-9f25-bfc92ad06a86" status: 200 len: 1519 microversion: 2.1 time: 0.216586 Jun 29 08:04:10.255015 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 59/122] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:04:10 2022] GET /compute/v2.1/servers/4f1bbb36-8695-4b09-9f25-bfc92ad06a86 => generated 1519 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 08:04:11.274110 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-a42323e9-e40b-4a3e-bec0-3d8b9b8ca859 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:04:11.274752 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-a42323e9-e40b-4a3e-bec0-3d8b9b8ca859 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] [instance: 4f1bbb36-8695-4b09-9f25-bfc92ad06a86] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:04:11.281381 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-a42323e9-e40b-4a3e-bec0-3d8b9b8ca859 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:04:11.281821 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-a42323e9-e40b-4a3e-bec0-3d8b9b8ca859 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:04:11.282618 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-a42323e9-e40b-4a3e-bec0-3d8b9b8ca859 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:04:11.283055 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-a42323e9-e40b-4a3e-bec0-3d8b9b8ca859 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:04:11.515578 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-a42323e9-e40b-4a3e-bec0-3d8b9b8ca859 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4af4eedee24897be2e702ef51873b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab693125979f4bb7b7b3c94061610fe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:04:11.529858 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-a42323e9-e40b-4a3e-bec0-3d8b9b8ca859 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] 10.222.0.43 "GET /compute/v2.1/servers/4f1bbb36-8695-4b09-9f25-bfc92ad06a86" status: 200 len: 1519 microversion: 2.1 time: 0.260457 Jun 29 08:04:11.530455 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 64/123] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:04:11 2022] GET /compute/v2.1/servers/4f1bbb36-8695-4b09-9f25-bfc92ad06a86 => generated 1519 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:04:12.546089 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-2fef307e-05ab-4802-849a-4638e2d56af4 tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:04:12.546753 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-2fef307e-05ab-4802-849a-4638e2d56af4 tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] [instance: b4774888-237c-41c5-8c79-7a6e34d17d70] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:04:12.555176 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-d2a40583-81ed-4401-8a9d-9a0e936084ce tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:04:12.556340 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-d2a40583-81ed-4401-8a9d-9a0e936084ce tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] [instance: 4f1bbb36-8695-4b09-9f25-bfc92ad06a86] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:04:12.562878 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-2fef307e-05ab-4802-849a-4638e2d56af4 tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:04:12.563332 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-2fef307e-05ab-4802-849a-4638e2d56af4 tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:04:12.564143 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-2fef307e-05ab-4802-849a-4638e2d56af4 tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:04:12.564627 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-2fef307e-05ab-4802-849a-4638e2d56af4 tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:04:12.567195 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-d2a40583-81ed-4401-8a9d-9a0e936084ce tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:04:12.568896 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-d2a40583-81ed-4401-8a9d-9a0e936084ce tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:04:12.570866 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-d2a40583-81ed-4401-8a9d-9a0e936084ce tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:04:12.571741 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-d2a40583-81ed-4401-8a9d-9a0e936084ce tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:04:12.600130 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-2fef307e-05ab-4802-849a-4638e2d56af4 tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] [instance: b4774888-237c-41c5-8c79-7a6e34d17d70] Going to try to terminate instance {{(pid=117890) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 29 08:04:12.748019 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-2fef307e-05ab-4802-849a-4638e2d56af4 tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] 10.222.0.43 "DELETE /compute/v2.1/servers/b4774888-237c-41c5-8c79-7a6e34d17d70" status: 204 len: 0 microversion: 2.1 time: 0.205687 Jun 29 08:04:12.752841 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 60/124] 10.222.0.43 () {58 vars in 1238 bytes} [Wed Jun 29 08:04:12 2022] DELETE /compute/v2.1/servers/b4774888-237c-41c5-8c79-7a6e34d17d70 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 29 08:04:12.764363 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-3a64a784-e731-41bb-b5f4-e65c194ac984 tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:04:12.766276 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-3a64a784-e731-41bb-b5f4-e65c194ac984 tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] [instance: b4774888-237c-41c5-8c79-7a6e34d17d70] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:04:12.776357 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-3a64a784-e731-41bb-b5f4-e65c194ac984 tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:04:12.776715 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-3a64a784-e731-41bb-b5f4-e65c194ac984 tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:04:12.777796 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-3a64a784-e731-41bb-b5f4-e65c194ac984 tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:04:12.778295 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-3a64a784-e731-41bb-b5f4-e65c194ac984 tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:04:12.860254 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-d2a40583-81ed-4401-8a9d-9a0e936084ce tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4af4eedee24897be2e702ef51873b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab693125979f4bb7b7b3c94061610fe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:04:12.877451 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-d2a40583-81ed-4401-8a9d-9a0e936084ce tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] 10.222.0.43 "GET /compute/v2.1/servers/4f1bbb36-8695-4b09-9f25-bfc92ad06a86" status: 200 len: 1519 microversion: 2.1 time: 0.330287 Jun 29 08:04:12.879272 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 65/125] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:04:12 2022] GET /compute/v2.1/servers/4f1bbb36-8695-4b09-9f25-bfc92ad06a86 => generated 1519 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 08:04:12.992918 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-3a64a784-e731-41bb-b5f4-e65c194ac984 tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0800a22846504b0d9c49e1520a69e45b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46c6cdc3217456dba6eda8ff23e9f3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:04:13.001958 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-3a64a784-e731-41bb-b5f4-e65c194ac984 tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] 10.222.0.43 "GET /compute/v2.1/servers/b4774888-237c-41c5-8c79-7a6e34d17d70" status: 200 len: 1554 microversion: 2.1 time: 0.247235 Jun 29 08:04:13.007427 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 61/126] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:04:12 2022] GET /compute/v2.1/servers/b4774888-237c-41c5-8c79-7a6e34d17d70 => generated 1554 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:04:13.897898 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-a5004f06-187a-4e94-afcb-5d03619b3a2c tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:04:13.898495 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-a5004f06-187a-4e94-afcb-5d03619b3a2c tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] [instance: 4f1bbb36-8695-4b09-9f25-bfc92ad06a86] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:04:13.914729 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-a5004f06-187a-4e94-afcb-5d03619b3a2c tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:04:13.915175 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-a5004f06-187a-4e94-afcb-5d03619b3a2c tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:04:13.915959 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-a5004f06-187a-4e94-afcb-5d03619b3a2c tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:04:13.916386 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-a5004f06-187a-4e94-afcb-5d03619b3a2c tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:04:14.027079 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-20e8ede8-fb98-4e67-a6ba-af3177e4e4a8 tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:04:14.030204 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-20e8ede8-fb98-4e67-a6ba-af3177e4e4a8 tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] [instance: b4774888-237c-41c5-8c79-7a6e34d17d70] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:04:14.046151 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-20e8ede8-fb98-4e67-a6ba-af3177e4e4a8 tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:04:14.046785 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-20e8ede8-fb98-4e67-a6ba-af3177e4e4a8 tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:04:14.050312 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-20e8ede8-fb98-4e67-a6ba-af3177e4e4a8 tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:04:14.050312 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-20e8ede8-fb98-4e67-a6ba-af3177e4e4a8 tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:04:14.098038 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-a5004f06-187a-4e94-afcb-5d03619b3a2c tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4af4eedee24897be2e702ef51873b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab693125979f4bb7b7b3c94061610fe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:04:14.108357 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-a5004f06-187a-4e94-afcb-5d03619b3a2c tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] 10.222.0.43 "GET /compute/v2.1/servers/4f1bbb36-8695-4b09-9f25-bfc92ad06a86" status: 200 len: 1519 microversion: 2.1 time: 0.214216 Jun 29 08:04:14.120251 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 66/127] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:04:13 2022] GET /compute/v2.1/servers/4f1bbb36-8695-4b09-9f25-bfc92ad06a86 => generated 1519 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:04:14.307635 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-20e8ede8-fb98-4e67-a6ba-af3177e4e4a8 tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0800a22846504b0d9c49e1520a69e45b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46c6cdc3217456dba6eda8ff23e9f3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:04:14.316688 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-20e8ede8-fb98-4e67-a6ba-af3177e4e4a8 tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] 10.222.0.43 "GET /compute/v2.1/servers/b4774888-237c-41c5-8c79-7a6e34d17d70" status: 200 len: 1554 microversion: 2.1 time: 0.297973 Jun 29 08:04:14.317456 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 62/128] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:04:14 2022] GET /compute/v2.1/servers/b4774888-237c-41c5-8c79-7a6e34d17d70 => generated 1554 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:04:15.127610 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-c994bd6b-bd65-42e3-ba59-c1d5d8746be5 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:04:15.128766 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-c994bd6b-bd65-42e3-ba59-c1d5d8746be5 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] [instance: 4f1bbb36-8695-4b09-9f25-bfc92ad06a86] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:04:15.138642 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c994bd6b-bd65-42e3-ba59-c1d5d8746be5 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:04:15.139255 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c994bd6b-bd65-42e3-ba59-c1d5d8746be5 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:04:15.140178 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c994bd6b-bd65-42e3-ba59-c1d5d8746be5 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:04:15.140733 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c994bd6b-bd65-42e3-ba59-c1d5d8746be5 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:04:15.345646 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-73339f66-5eff-4204-86d1-5abb27deb358 tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:04:15.347174 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-73339f66-5eff-4204-86d1-5abb27deb358 tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] [instance: b4774888-237c-41c5-8c79-7a6e34d17d70] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:04:15.358188 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-73339f66-5eff-4204-86d1-5abb27deb358 tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:04:15.359569 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-73339f66-5eff-4204-86d1-5abb27deb358 tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:04:15.361610 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-73339f66-5eff-4204-86d1-5abb27deb358 tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:04:15.363342 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-73339f66-5eff-4204-86d1-5abb27deb358 tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:04:15.372452 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-c994bd6b-bd65-42e3-ba59-c1d5d8746be5 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4af4eedee24897be2e702ef51873b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab693125979f4bb7b7b3c94061610fe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:04:15.386806 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-c994bd6b-bd65-42e3-ba59-c1d5d8746be5 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] 10.222.0.43 "GET /compute/v2.1/servers/4f1bbb36-8695-4b09-9f25-bfc92ad06a86" status: 200 len: 1519 microversion: 2.1 time: 0.263809 Jun 29 08:04:15.388498 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 67/129] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:04:15 2022] GET /compute/v2.1/servers/4f1bbb36-8695-4b09-9f25-bfc92ad06a86 => generated 1519 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:04:15.638847 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-73339f66-5eff-4204-86d1-5abb27deb358 tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0800a22846504b0d9c49e1520a69e45b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46c6cdc3217456dba6eda8ff23e9f3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:04:15.650347 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-73339f66-5eff-4204-86d1-5abb27deb358 tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] 10.222.0.43 "GET /compute/v2.1/servers/b4774888-237c-41c5-8c79-7a6e34d17d70" status: 200 len: 1554 microversion: 2.1 time: 0.311482 Jun 29 08:04:15.651845 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 63/130] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:04:15 2022] GET /compute/v2.1/servers/b4774888-237c-41c5-8c79-7a6e34d17d70 => generated 1554 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 08:04:16.374113 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [req-166b2026-f65b-41e3-a7b1-2cf707ed844d req-44838259-ced9-4bc4-957f-b4da1947486a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4774888-237c-41c5-8c79-7a6e34d17d70", "name": "network-vif-deleted", "tag": "11e73db4-c785-4473-850c-cf5dba7670fc"}]} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:04:16.391678 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-166b2026-f65b-41e3-a7b1-2cf707ed844d req-44838259-ced9-4bc4-957f-b4da1947486a service nova] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:04:16.392654 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-166b2026-f65b-41e3-a7b1-2cf707ed844d req-44838259-ced9-4bc4-957f-b4da1947486a service nova] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:04:16.419777 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-6901e1e2-a531-4437-9f2b-3a35ac14e441 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:04:16.420659 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.compute.server_external_events [req-166b2026-f65b-41e3-a7b1-2cf707ed844d req-44838259-ced9-4bc4-957f-b4da1947486a service nova] Creating event network-vif-deleted:11e73db4-c785-4473-850c-cf5dba7670fc for instance b4774888-237c-41c5-8c79-7a6e34d17d70 on hv-cinder-76810 Jun 29 08:04:16.421420 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-6901e1e2-a531-4437-9f2b-3a35ac14e441 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] [instance: 4f1bbb36-8695-4b09-9f25-bfc92ad06a86] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:04:16.432851 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-6901e1e2-a531-4437-9f2b-3a35ac14e441 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:04:16.433619 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-6901e1e2-a531-4437-9f2b-3a35ac14e441 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:04:16.434618 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-6901e1e2-a531-4437-9f2b-3a35ac14e441 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:04:16.435451 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-6901e1e2-a531-4437-9f2b-3a35ac14e441 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:04:16.445836 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [req-166b2026-f65b-41e3-a7b1-2cf707ed844d req-44838259-ced9-4bc4-957f-b4da1947486a service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077124 Jun 29 08:04:16.446785 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 68/131] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jun 29 08:04:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:04:16.670407 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-6901e1e2-a531-4437-9f2b-3a35ac14e441 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4af4eedee24897be2e702ef51873b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab693125979f4bb7b7b3c94061610fe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:04:16.671773 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-a264ca63-cdf2-4549-99e1-d40469a74bcb tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:04:16.672551 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-a264ca63-cdf2-4549-99e1-d40469a74bcb tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] [instance: b4774888-237c-41c5-8c79-7a6e34d17d70] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:04:16.680861 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-a264ca63-cdf2-4549-99e1-d40469a74bcb tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:04:16.681377 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-a264ca63-cdf2-4549-99e1-d40469a74bcb tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:04:16.682249 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-a264ca63-cdf2-4549-99e1-d40469a74bcb tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:04:16.682762 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-a264ca63-cdf2-4549-99e1-d40469a74bcb tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:04:16.687122 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-6901e1e2-a531-4437-9f2b-3a35ac14e441 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] 10.222.0.43 "GET /compute/v2.1/servers/4f1bbb36-8695-4b09-9f25-bfc92ad06a86" status: 200 len: 1519 microversion: 2.1 time: 0.273621 Jun 29 08:04:16.687929 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 64/132] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:04:16 2022] GET /compute/v2.1/servers/4f1bbb36-8695-4b09-9f25-bfc92ad06a86 => generated 1519 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 08:04:16.781336 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-a264ca63-cdf2-4549-99e1-d40469a74bcb tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0800a22846504b0d9c49e1520a69e45b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46c6cdc3217456dba6eda8ff23e9f3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:04:16.791979 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-a264ca63-cdf2-4549-99e1-d40469a74bcb tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] 10.222.0.43 "GET /compute/v2.1/servers/b4774888-237c-41c5-8c79-7a6e34d17d70" status: 200 len: 1345 microversion: 2.1 time: 0.125496 Jun 29 08:04:16.792691 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 69/133] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:04:16 2022] GET /compute/v2.1/servers/b4774888-237c-41c5-8c79-7a6e34d17d70 => generated 1345 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 08:04:17.704735 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-c2366eab-ad92-4d9d-acd6-30ae92e5d712 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:04:17.705411 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-c2366eab-ad92-4d9d-acd6-30ae92e5d712 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] [instance: 4f1bbb36-8695-4b09-9f25-bfc92ad06a86] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:04:17.713444 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-c2366eab-ad92-4d9d-acd6-30ae92e5d712 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:04:17.714000 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-c2366eab-ad92-4d9d-acd6-30ae92e5d712 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:04:17.714859 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-c2366eab-ad92-4d9d-acd6-30ae92e5d712 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:04:17.715379 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-c2366eab-ad92-4d9d-acd6-30ae92e5d712 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:04:17.811098 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-8bca2a75-76f7-4d5c-9fc5-240a5cf2c143 tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:04:17.811705 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-8bca2a75-76f7-4d5c-9fc5-240a5cf2c143 tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] [instance: b4774888-237c-41c5-8c79-7a6e34d17d70] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:04:17.818917 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-8bca2a75-76f7-4d5c-9fc5-240a5cf2c143 tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:04:17.819497 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-8bca2a75-76f7-4d5c-9fc5-240a5cf2c143 tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:04:17.820423 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-8bca2a75-76f7-4d5c-9fc5-240a5cf2c143 tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:04:17.821265 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-8bca2a75-76f7-4d5c-9fc5-240a5cf2c143 tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:04:17.872637 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-c2366eab-ad92-4d9d-acd6-30ae92e5d712 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4af4eedee24897be2e702ef51873b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab693125979f4bb7b7b3c94061610fe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:04:17.875702 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG dbcounter [-] [117890] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:04:17.884224 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-c2366eab-ad92-4d9d-acd6-30ae92e5d712 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] 10.222.0.43 "GET /compute/v2.1/servers/4f1bbb36-8695-4b09-9f25-bfc92ad06a86" status: 200 len: 1519 microversion: 2.1 time: 0.183204 Jun 29 08:04:17.884878 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 65/134] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:04:17 2022] GET /compute/v2.1/servers/4f1bbb36-8695-4b09-9f25-bfc92ad06a86 => generated 1519 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:04:17.895499 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-8bca2a75-76f7-4d5c-9fc5-240a5cf2c143 tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0800a22846504b0d9c49e1520a69e45b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46c6cdc3217456dba6eda8ff23e9f3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:04:17.905076 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-8bca2a75-76f7-4d5c-9fc5-240a5cf2c143 tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] 10.222.0.43 "GET /compute/v2.1/servers/b4774888-237c-41c5-8c79-7a6e34d17d70" status: 200 len: 1345 microversion: 2.1 time: 0.097803 Jun 29 08:04:17.905668 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 70/135] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:04:17 2022] GET /compute/v2.1/servers/b4774888-237c-41c5-8c79-7a6e34d17d70 => generated 1345 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 08:04:18.902556 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-c52b6a43-40cf-4646-a536-43bbf1609df5 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:04:18.903174 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-c52b6a43-40cf-4646-a536-43bbf1609df5 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] [instance: 4f1bbb36-8695-4b09-9f25-bfc92ad06a86] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:04:18.910740 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-c52b6a43-40cf-4646-a536-43bbf1609df5 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:04:18.911192 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-c52b6a43-40cf-4646-a536-43bbf1609df5 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:04:18.912784 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-c52b6a43-40cf-4646-a536-43bbf1609df5 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:04:18.913265 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-c52b6a43-40cf-4646-a536-43bbf1609df5 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:04:18.923848 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-0f51e8aa-5255-47fe-9594-35829d494398 tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:04:18.924633 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-0f51e8aa-5255-47fe-9594-35829d494398 tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] [instance: b4774888-237c-41c5-8c79-7a6e34d17d70] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:04:18.931682 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-0f51e8aa-5255-47fe-9594-35829d494398 tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:04:18.932141 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-0f51e8aa-5255-47fe-9594-35829d494398 tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:04:18.932938 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-0f51e8aa-5255-47fe-9594-35829d494398 tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:04:18.933401 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-0f51e8aa-5255-47fe-9594-35829d494398 tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:04:18.936527 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_cell1:SELECT=100 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:04:19.007413 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-0f51e8aa-5255-47fe-9594-35829d494398 tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0800a22846504b0d9c49e1520a69e45b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46c6cdc3217456dba6eda8ff23e9f3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:04:19.021568 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-0f51e8aa-5255-47fe-9594-35829d494398 tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] 10.222.0.43 "GET /compute/v2.1/servers/b4774888-237c-41c5-8c79-7a6e34d17d70" status: 200 len: 1345 microversion: 2.1 time: 0.100046 Jun 29 08:04:19.022238 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 71/136] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:04:18 2022] GET /compute/v2.1/servers/b4774888-237c-41c5-8c79-7a6e34d17d70 => generated 1345 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 08:04:19.080821 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-c52b6a43-40cf-4646-a536-43bbf1609df5 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4af4eedee24897be2e702ef51873b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab693125979f4bb7b7b3c94061610fe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:04:19.090790 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-c52b6a43-40cf-4646-a536-43bbf1609df5 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] 10.222.0.43 "GET /compute/v2.1/servers/4f1bbb36-8695-4b09-9f25-bfc92ad06a86" status: 200 len: 1519 microversion: 2.1 time: 0.192563 Jun 29 08:04:19.091390 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 66/137] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:04:18 2022] GET /compute/v2.1/servers/4f1bbb36-8695-4b09-9f25-bfc92ad06a86 => generated 1519 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 08:04:20.046663 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-1c195478-da90-41cb-8f20-5b20155bcb4a tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:04:20.047337 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-1c195478-da90-41cb-8f20-5b20155bcb4a tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] [instance: b4774888-237c-41c5-8c79-7a6e34d17d70] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:04:20.054783 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-1c195478-da90-41cb-8f20-5b20155bcb4a tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:04:20.055243 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-1c195478-da90-41cb-8f20-5b20155bcb4a tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:04:20.056047 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-1c195478-da90-41cb-8f20-5b20155bcb4a tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:04:20.056489 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-1c195478-da90-41cb-8f20-5b20155bcb4a tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:04:20.111606 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-662fc5a8-bc23-4023-840b-668c85c4b8b3 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:04:20.114236 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-662fc5a8-bc23-4023-840b-668c85c4b8b3 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] [instance: 4f1bbb36-8695-4b09-9f25-bfc92ad06a86] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:04:20.126656 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-662fc5a8-bc23-4023-840b-668c85c4b8b3 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:04:20.127111 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-662fc5a8-bc23-4023-840b-668c85c4b8b3 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:04:20.127906 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-662fc5a8-bc23-4023-840b-668c85c4b8b3 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:04:20.128347 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-662fc5a8-bc23-4023-840b-668c85c4b8b3 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:04:20.142297 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-1c195478-da90-41cb-8f20-5b20155bcb4a tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0800a22846504b0d9c49e1520a69e45b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46c6cdc3217456dba6eda8ff23e9f3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:04:20.157349 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-1c195478-da90-41cb-8f20-5b20155bcb4a tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] 10.222.0.43 "GET /compute/v2.1/servers/b4774888-237c-41c5-8c79-7a6e34d17d70" status: 200 len: 1345 microversion: 2.1 time: 0.114096 Jun 29 08:04:20.158392 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 72/138] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:04:20 2022] GET /compute/v2.1/servers/b4774888-237c-41c5-8c79-7a6e34d17d70 => generated 1345 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:04:20.336285 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-662fc5a8-bc23-4023-840b-668c85c4b8b3 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4af4eedee24897be2e702ef51873b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab693125979f4bb7b7b3c94061610fe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:04:20.345018 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-662fc5a8-bc23-4023-840b-668c85c4b8b3 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] 10.222.0.43 "GET /compute/v2.1/servers/4f1bbb36-8695-4b09-9f25-bfc92ad06a86" status: 200 len: 1519 microversion: 2.1 time: 0.239470 Jun 29 08:04:20.346120 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 67/139] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:04:20 2022] GET /compute/v2.1/servers/4f1bbb36-8695-4b09-9f25-bfc92ad06a86 => generated 1519 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:04:21.176771 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-18782aeb-ca87-4490-83dc-f11cfaa89881 tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:04:21.178534 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-18782aeb-ca87-4490-83dc-f11cfaa89881 tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] [instance: b4774888-237c-41c5-8c79-7a6e34d17d70] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:04:21.187024 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-18782aeb-ca87-4490-83dc-f11cfaa89881 tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:04:21.187719 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-18782aeb-ca87-4490-83dc-f11cfaa89881 tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:04:21.188805 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-18782aeb-ca87-4490-83dc-f11cfaa89881 tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:04:21.189414 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-18782aeb-ca87-4490-83dc-f11cfaa89881 tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:04:21.208012 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.wsgi [None req-18782aeb-ca87-4490-83dc-f11cfaa89881 tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] HTTP exception thrown: Instance b4774888-237c-41c5-8c79-7a6e34d17d70 could not be found. Jun 29 08:04:21.213493 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-18782aeb-ca87-4490-83dc-f11cfaa89881 tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] Request method failure captured: Jun 29 08:04:21.213493 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: request: GET /compute/v2.1/servers/b4774888-237c-41c5-8c79-7a6e34d17d70 HTTP/1.1 Jun 29 08:04:21.213493 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: Accept: application/json Jun 29 08:04:21.213493 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: Accept-Encoding: identity Jun 29 08:04:21.213493 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: Connection: close Jun 29 08:04:21.213493 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: Content-Length: 0 Jun 29 08:04:21.213493 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: Content-Type: application/json Jun 29 08:04:21.213493 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: Host: 10.222.0.43 Jun 29 08:04:21.213493 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: Openstack-System-Scope: None Jun 29 08:04:21.213493 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: User-Agent: python-urllib3/1.26.9 Jun 29 08:04:21.213493 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Auth-Token: gAAAAABivAczFcmdq6YwmRdVxcwPKMAoeMTB77LO1LGia6wPrifPg5Oe-keoxk7Ew_3AFO_TouFYtwitH0GfoB_85xe2eRLdZgUvcRWGh54UYFy4nV5E4c1sx1nUoEDloAlCU9-ir78VGBpa61lVbFVUtgbD6svpGYtuwUuF_hRAVKE7jTcB2a4 Jun 29 08:04:21.213493 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Domain-Id: None Jun 29 08:04:21.213493 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Domain-Name: None Jun 29 08:04:21.213493 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Identity-Status: Confirmed Jun 29 08:04:21.213493 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Is-Admin-Project: True Jun 29 08:04:21.213493 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Project-Domain-Id: default Jun 29 08:04:21.213493 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Project-Domain-Name: Default Jun 29 08:04:21.213493 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Project-Id: f46c6cdc3217456dba6eda8ff23e9f3a Jun 29 08:04:21.213493 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Project-Name: tempest-DeleteServersTestJSON-1859056524 Jun 29 08:04:21.213493 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Role: member,reader Jun 29 08:04:21.213493 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Roles: member,reader Jun 29 08:04:21.215599 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f46c6cdc3217456dba6eda8ff23e9f3a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_f46c6cdc3217456dba6eda8ff23e9f3a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f46c6cdc3217456dba6eda8ff23e9f3a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/f46c6cdc3217456dba6eda8ff23e9f3a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Jun 29 08:04:21.215599 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Tenant: tempest-DeleteServersTestJSON-1859056524 Jun 29 08:04:21.215599 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Tenant-Id: f46c6cdc3217456dba6eda8ff23e9f3a Jun 29 08:04:21.215599 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Tenant-Name: tempest-DeleteServersTestJSON-1859056524 Jun 29 08:04:21.215599 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-User: tempest-DeleteServersTestJSON-1859056524-project Jun 29 08:04:21.215599 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-User-Domain-Id: default Jun 29 08:04:21.215599 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-User-Domain-Name: Default Jun 29 08:04:21.215599 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-User-Id: 0800a22846504b0d9c49e1520a69e45b Jun 29 08:04:21.215599 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-User-Name: tempest-DeleteServersTestJSON-1859056524-project Jun 29 08:04:21.215599 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: method: > Jun 29 08:04:21.215599 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: exception: Instance b4774888-237c-41c5-8c79-7a6e34d17d70 could not be found. Jun 29 08:04:21.215599 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: action_args: {'id': 'b4774888-237c-41c5-8c79-7a6e34d17d70'} Jun 29 08:04:21.216746 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 08:04:21.216746 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:04:21.216746 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 29 08:04:21.216746 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 29 08:04:21.216746 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 29 08:04:21.216746 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 29 08:04:21.216746 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 29 08:04:21.216746 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 29 08:04:21.216746 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 29 08:04:21.216746 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 29 08:04:21.216746 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b4774888-237c-41c5-8c79-7a6e34d17d70 could not be found. Jun 29 08:04:21.216746 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 29 08:04:21.216746 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 08:04:21.216746 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 29 08:04:21.216746 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:04:21.216746 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 08:04:21.216746 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 08:04:21.216746 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 08:04:21.216746 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 08:04:21.216746 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 08:04:21.218613 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 08:04:21.218613 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 29 08:04:21.218613 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 29 08:04:21.218613 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 29 08:04:21.218613 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 29 08:04:21.218613 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 29 08:04:21.218613 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 29 08:04:21.218613 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b4774888-237c-41c5-8c79-7a6e34d17d70 could not be found. Jun 29 08:04:21.218613 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 29 08:04:21.218613 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 08:04:21.218613 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 29 08:04:21.218613 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:04:21.218613 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 08:04:21.218613 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 08:04:21.218613 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 08:04:21.218613 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 08:04:21.218613 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b4774888-237c-41c5-8c79-7a6e34d17d70 could not be found. Jun 29 08:04:21.218613 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 29 08:04:21.220439 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-18782aeb-ca87-4490-83dc-f11cfaa89881 tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] Returning 404 to user: Instance b4774888-237c-41c5-8c79-7a6e34d17d70 could not be found. {{(pid=117889) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 08:04:21.220439 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-18782aeb-ca87-4490-83dc-f11cfaa89881 tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] 10.222.0.43 "GET /compute/v2.1/servers/b4774888-237c-41c5-8c79-7a6e34d17d70" status: 404 len: 111 microversion: 2.1 time: 0.043427 Jun 29 08:04:21.220439 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 73/140] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:04:21 2022] GET /compute/v2.1/servers/b4774888-237c-41c5-8c79-7a6e34d17d70 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 29 08:04:21.378525 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-667bee76-d31f-4714-add9-dc1139311a62 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:04:21.379663 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-667bee76-d31f-4714-add9-dc1139311a62 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] [instance: 4f1bbb36-8695-4b09-9f25-bfc92ad06a86] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:04:21.389686 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-55c2c185-afdc-40b7-889a-a791ad21609e tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:04:21.390686 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-55c2c185-afdc-40b7-889a-a791ad21609e tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] [instance: b4774888-237c-41c5-8c79-7a6e34d17d70] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:04:21.392495 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-667bee76-d31f-4714-add9-dc1139311a62 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:04:21.393009 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-667bee76-d31f-4714-add9-dc1139311a62 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:04:21.394272 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-667bee76-d31f-4714-add9-dc1139311a62 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:04:21.394895 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-667bee76-d31f-4714-add9-dc1139311a62 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:04:21.400480 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-55c2c185-afdc-40b7-889a-a791ad21609e tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:04:21.400927 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-55c2c185-afdc-40b7-889a-a791ad21609e tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:04:21.401779 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-55c2c185-afdc-40b7-889a-a791ad21609e tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:04:21.402420 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-55c2c185-afdc-40b7-889a-a791ad21609e tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:04:21.420044 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.wsgi [None req-55c2c185-afdc-40b7-889a-a791ad21609e tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] HTTP exception thrown: Instance b4774888-237c-41c5-8c79-7a6e34d17d70 could not be found. Jun 29 08:04:21.422897 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-55c2c185-afdc-40b7-889a-a791ad21609e tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] Request method failure captured: Jun 29 08:04:21.422897 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: request: GET /compute/v2.1/servers/b4774888-237c-41c5-8c79-7a6e34d17d70/os-volume_attachments HTTP/1.1 Jun 29 08:04:21.422897 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: Accept: application/json Jun 29 08:04:21.422897 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: Accept-Encoding: identity Jun 29 08:04:21.422897 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: Connection: close Jun 29 08:04:21.422897 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: Content-Length: 0 Jun 29 08:04:21.422897 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: Content-Type: application/json Jun 29 08:04:21.422897 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: Host: 10.222.0.43 Jun 29 08:04:21.422897 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: Openstack-System-Scope: None Jun 29 08:04:21.422897 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: User-Agent: python-urllib3/1.26.9 Jun 29 08:04:21.422897 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Auth-Token: gAAAAABivAczFcmdq6YwmRdVxcwPKMAoeMTB77LO1LGia6wPrifPg5Oe-keoxk7Ew_3AFO_TouFYtwitH0GfoB_85xe2eRLdZgUvcRWGh54UYFy4nV5E4c1sx1nUoEDloAlCU9-ir78VGBpa61lVbFVUtgbD6svpGYtuwUuF_hRAVKE7jTcB2a4 Jun 29 08:04:21.422897 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Domain-Id: None Jun 29 08:04:21.422897 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Domain-Name: None Jun 29 08:04:21.422897 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Identity-Status: Confirmed Jun 29 08:04:21.422897 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Is-Admin-Project: True Jun 29 08:04:21.422897 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Project-Domain-Id: default Jun 29 08:04:21.422897 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Project-Domain-Name: Default Jun 29 08:04:21.422897 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Project-Id: f46c6cdc3217456dba6eda8ff23e9f3a Jun 29 08:04:21.422897 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Project-Name: tempest-DeleteServersTestJSON-1859056524 Jun 29 08:04:21.422897 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Role: member,reader Jun 29 08:04:21.422897 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Roles: member,reader Jun 29 08:04:21.424161 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f46c6cdc3217456dba6eda8ff23e9f3a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_f46c6cdc3217456dba6eda8ff23e9f3a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f46c6cdc3217456dba6eda8ff23e9f3a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/f46c6cdc3217456dba6eda8ff23e9f3a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Jun 29 08:04:21.424161 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Tenant: tempest-DeleteServersTestJSON-1859056524 Jun 29 08:04:21.424161 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Tenant-Id: f46c6cdc3217456dba6eda8ff23e9f3a Jun 29 08:04:21.424161 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Tenant-Name: tempest-DeleteServersTestJSON-1859056524 Jun 29 08:04:21.424161 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-User: tempest-DeleteServersTestJSON-1859056524-project Jun 29 08:04:21.424161 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-User-Domain-Id: default Jun 29 08:04:21.424161 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-User-Domain-Name: Default Jun 29 08:04:21.424161 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-User-Id: 0800a22846504b0d9c49e1520a69e45b Jun 29 08:04:21.424161 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-User-Name: tempest-DeleteServersTestJSON-1859056524-project Jun 29 08:04:21.424161 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: method: > Jun 29 08:04:21.424161 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: exception: Instance b4774888-237c-41c5-8c79-7a6e34d17d70 could not be found. Jun 29 08:04:21.424161 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: action_args: {'server_id': 'b4774888-237c-41c5-8c79-7a6e34d17d70'} Jun 29 08:04:21.425057 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 08:04:21.425057 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:04:21.425057 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 29 08:04:21.425057 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 29 08:04:21.425057 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 29 08:04:21.425057 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 29 08:04:21.425057 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 29 08:04:21.425057 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 29 08:04:21.425057 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 29 08:04:21.425057 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 29 08:04:21.425057 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b4774888-237c-41c5-8c79-7a6e34d17d70 could not be found. Jun 29 08:04:21.425057 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 29 08:04:21.425057 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 08:04:21.425057 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 29 08:04:21.425057 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:04:21.425057 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 08:04:21.425057 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 08:04:21.425057 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 08:04:21.425057 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 08:04:21.425057 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 08:04:21.426764 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 08:04:21.426764 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 29 08:04:21.426764 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 29 08:04:21.426764 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 29 08:04:21.426764 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 29 08:04:21.426764 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jun 29 08:04:21.426764 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jun 29 08:04:21.426764 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 29 08:04:21.426764 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 29 08:04:21.426764 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b4774888-237c-41c5-8c79-7a6e34d17d70 could not be found. Jun 29 08:04:21.426764 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 29 08:04:21.426764 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 08:04:21.426764 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 29 08:04:21.426764 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:04:21.426764 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 08:04:21.426764 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 08:04:21.426764 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 08:04:21.426764 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 08:04:21.426764 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b4774888-237c-41c5-8c79-7a6e34d17d70 could not be found. Jun 29 08:04:21.426764 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 29 08:04:21.431313 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-55c2c185-afdc-40b7-889a-a791ad21609e tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] Returning 404 to user: Instance b4774888-237c-41c5-8c79-7a6e34d17d70 could not be found. {{(pid=117889) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 08:04:21.432206 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-55c2c185-afdc-40b7-889a-a791ad21609e tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] 10.222.0.43 "GET /compute/v2.1/servers/b4774888-237c-41c5-8c79-7a6e34d17d70/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.047037 Jun 29 08:04:21.432780 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 74/141] 10.222.0.43 () {58 vars in 1301 bytes} [Wed Jun 29 08:04:21 2022] GET /compute/v2.1/servers/b4774888-237c-41c5-8c79-7a6e34d17d70/os-volume_attachments => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 29 08:04:21.628141 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-667bee76-d31f-4714-add9-dc1139311a62 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4af4eedee24897be2e702ef51873b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab693125979f4bb7b7b3c94061610fe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:04:21.645335 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-667bee76-d31f-4714-add9-dc1139311a62 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] 10.222.0.43 "GET /compute/v2.1/servers/4f1bbb36-8695-4b09-9f25-bfc92ad06a86" status: 200 len: 1519 microversion: 2.1 time: 0.274431 Jun 29 08:04:21.646739 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 68/142] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:04:21 2022] GET /compute/v2.1/servers/4f1bbb36-8695-4b09-9f25-bfc92ad06a86 => generated 1519 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:04:22.674137 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-e338c1f5-a8eb-49de-af1a-a5a800310d87 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:04:22.676492 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-e338c1f5-a8eb-49de-af1a-a5a800310d87 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] [instance: 4f1bbb36-8695-4b09-9f25-bfc92ad06a86] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:04:22.696770 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e338c1f5-a8eb-49de-af1a-a5a800310d87 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:04:22.697620 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e338c1f5-a8eb-49de-af1a-a5a800310d87 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:04:22.704187 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e338c1f5-a8eb-49de-af1a-a5a800310d87 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:04:22.704752 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e338c1f5-a8eb-49de-af1a-a5a800310d87 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:04:22.734461 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-cbdb2c98-7086-4abe-89ad-6693c99807d4 tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:04:22.735623 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-cbdb2c98-7086-4abe-89ad-6693c99807d4 tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] [instance: b4774888-237c-41c5-8c79-7a6e34d17d70] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:04:22.738872 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG dbcounter [-] [117890] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1 {{(pid=117890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:04:22.743613 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-cbdb2c98-7086-4abe-89ad-6693c99807d4 tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:04:22.744050 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-cbdb2c98-7086-4abe-89ad-6693c99807d4 tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:04:22.745066 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-cbdb2c98-7086-4abe-89ad-6693c99807d4 tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:04:22.745675 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-cbdb2c98-7086-4abe-89ad-6693c99807d4 tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:04:22.766828 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.wsgi [None req-cbdb2c98-7086-4abe-89ad-6693c99807d4 tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] HTTP exception thrown: Instance b4774888-237c-41c5-8c79-7a6e34d17d70 could not be found. Jun 29 08:04:22.774416 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-cbdb2c98-7086-4abe-89ad-6693c99807d4 tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] Request method failure captured: Jun 29 08:04:22.774416 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: request: DELETE /compute/v2.1/servers/b4774888-237c-41c5-8c79-7a6e34d17d70 HTTP/1.1 Jun 29 08:04:22.774416 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: Accept: application/json Jun 29 08:04:22.774416 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: Accept-Encoding: identity Jun 29 08:04:22.774416 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: Connection: close Jun 29 08:04:22.774416 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: Content-Length: 0 Jun 29 08:04:22.774416 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: Content-Type: application/json Jun 29 08:04:22.774416 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: Host: 10.222.0.43 Jun 29 08:04:22.774416 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: Openstack-System-Scope: None Jun 29 08:04:22.774416 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: User-Agent: python-urllib3/1.26.9 Jun 29 08:04:22.774416 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Auth-Token: gAAAAABivAczFcmdq6YwmRdVxcwPKMAoeMTB77LO1LGia6wPrifPg5Oe-keoxk7Ew_3AFO_TouFYtwitH0GfoB_85xe2eRLdZgUvcRWGh54UYFy4nV5E4c1sx1nUoEDloAlCU9-ir78VGBpa61lVbFVUtgbD6svpGYtuwUuF_hRAVKE7jTcB2a4 Jun 29 08:04:22.774416 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Domain-Id: None Jun 29 08:04:22.774416 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Domain-Name: None Jun 29 08:04:22.774416 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Identity-Status: Confirmed Jun 29 08:04:22.774416 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Is-Admin-Project: True Jun 29 08:04:22.774416 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Project-Domain-Id: default Jun 29 08:04:22.774416 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Project-Domain-Name: Default Jun 29 08:04:22.774416 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Project-Id: f46c6cdc3217456dba6eda8ff23e9f3a Jun 29 08:04:22.774416 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Project-Name: tempest-DeleteServersTestJSON-1859056524 Jun 29 08:04:22.774416 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Role: member,reader Jun 29 08:04:22.774416 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Roles: member,reader Jun 29 08:04:22.776113 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f46c6cdc3217456dba6eda8ff23e9f3a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_f46c6cdc3217456dba6eda8ff23e9f3a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f46c6cdc3217456dba6eda8ff23e9f3a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/f46c6cdc3217456dba6eda8ff23e9f3a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Jun 29 08:04:22.776113 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Tenant: tempest-DeleteServersTestJSON-1859056524 Jun 29 08:04:22.776113 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Tenant-Id: f46c6cdc3217456dba6eda8ff23e9f3a Jun 29 08:04:22.776113 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Tenant-Name: tempest-DeleteServersTestJSON-1859056524 Jun 29 08:04:22.776113 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-User: tempest-DeleteServersTestJSON-1859056524-project Jun 29 08:04:22.776113 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-User-Domain-Id: default Jun 29 08:04:22.776113 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-User-Domain-Name: Default Jun 29 08:04:22.776113 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-User-Id: 0800a22846504b0d9c49e1520a69e45b Jun 29 08:04:22.776113 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-User-Name: tempest-DeleteServersTestJSON-1859056524-project Jun 29 08:04:22.776113 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: method: > Jun 29 08:04:22.776113 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: exception: Instance b4774888-237c-41c5-8c79-7a6e34d17d70 could not be found. Jun 29 08:04:22.776113 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: action_args: {'id': 'b4774888-237c-41c5-8c79-7a6e34d17d70'} Jun 29 08:04:22.776739 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 08:04:22.776739 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:04:22.776739 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 29 08:04:22.776739 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 29 08:04:22.776739 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 29 08:04:22.776739 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 29 08:04:22.776739 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 29 08:04:22.776739 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 29 08:04:22.776739 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 29 08:04:22.776739 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 29 08:04:22.776739 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b4774888-237c-41c5-8c79-7a6e34d17d70 could not be found. Jun 29 08:04:22.776739 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 29 08:04:22.776739 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 08:04:22.776739 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 29 08:04:22.776739 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:04:22.776739 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 08:04:22.776739 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 08:04:22.776739 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 08:04:22.776739 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 08:04:22.776739 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 08:04:22.778270 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 08:04:22.778270 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 29 08:04:22.778270 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 29 08:04:22.778270 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 29 08:04:22.778270 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 29 08:04:22.778270 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 29 08:04:22.778270 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 29 08:04:22.778270 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 29 08:04:22.778270 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 29 08:04:22.778270 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b4774888-237c-41c5-8c79-7a6e34d17d70 could not be found. Jun 29 08:04:22.778270 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 29 08:04:22.778270 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 08:04:22.778270 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 29 08:04:22.778270 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:04:22.778270 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 08:04:22.778270 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 08:04:22.778270 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 08:04:22.778270 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 08:04:22.778270 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b4774888-237c-41c5-8c79-7a6e34d17d70 could not be found. Jun 29 08:04:22.778270 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 29 08:04:22.780456 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-cbdb2c98-7086-4abe-89ad-6693c99807d4 tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] Returning 404 to user: Instance b4774888-237c-41c5-8c79-7a6e34d17d70 could not be found. {{(pid=117890) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 08:04:22.780842 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-cbdb2c98-7086-4abe-89ad-6693c99807d4 tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] 10.222.0.43 "DELETE /compute/v2.1/servers/b4774888-237c-41c5-8c79-7a6e34d17d70" status: 404 len: 111 microversion: 2.1 time: 0.053903 Jun 29 08:04:22.782438 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 69/143] 10.222.0.43 () {58 vars in 1238 bytes} [Wed Jun 29 08:04:22 2022] DELETE /compute/v2.1/servers/b4774888-237c-41c5-8c79-7a6e34d17d70 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 29 08:04:22.792409 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-7e9adfed-8430-4756-827b-0e4b1b30b4e0 tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:04:22.793065 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-7e9adfed-8430-4756-827b-0e4b1b30b4e0 tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] [instance: b4774888-237c-41c5-8c79-7a6e34d17d70] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:04:22.800379 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-7e9adfed-8430-4756-827b-0e4b1b30b4e0 tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:04:22.803868 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-7e9adfed-8430-4756-827b-0e4b1b30b4e0 tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:04:22.805019 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-7e9adfed-8430-4756-827b-0e4b1b30b4e0 tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:04:22.805455 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-7e9adfed-8430-4756-827b-0e4b1b30b4e0 tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:04:22.828469 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.wsgi [None req-7e9adfed-8430-4756-827b-0e4b1b30b4e0 tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] HTTP exception thrown: Instance b4774888-237c-41c5-8c79-7a6e34d17d70 could not be found. Jun 29 08:04:22.830232 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-7e9adfed-8430-4756-827b-0e4b1b30b4e0 tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] Request method failure captured: Jun 29 08:04:22.830232 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: request: GET /compute/v2.1/servers/b4774888-237c-41c5-8c79-7a6e34d17d70 HTTP/1.1 Jun 29 08:04:22.830232 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: Accept: application/json Jun 29 08:04:22.830232 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: Accept-Encoding: identity Jun 29 08:04:22.830232 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: Connection: close Jun 29 08:04:22.830232 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: Content-Length: 0 Jun 29 08:04:22.830232 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: Content-Type: application/json Jun 29 08:04:22.830232 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: Host: 10.222.0.43 Jun 29 08:04:22.830232 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: Openstack-System-Scope: None Jun 29 08:04:22.830232 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: User-Agent: python-urllib3/1.26.9 Jun 29 08:04:22.830232 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Auth-Token: gAAAAABivAczFcmdq6YwmRdVxcwPKMAoeMTB77LO1LGia6wPrifPg5Oe-keoxk7Ew_3AFO_TouFYtwitH0GfoB_85xe2eRLdZgUvcRWGh54UYFy4nV5E4c1sx1nUoEDloAlCU9-ir78VGBpa61lVbFVUtgbD6svpGYtuwUuF_hRAVKE7jTcB2a4 Jun 29 08:04:22.830232 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Domain-Id: None Jun 29 08:04:22.830232 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Domain-Name: None Jun 29 08:04:22.830232 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Identity-Status: Confirmed Jun 29 08:04:22.830232 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Is-Admin-Project: True Jun 29 08:04:22.830232 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Project-Domain-Id: default Jun 29 08:04:22.830232 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Project-Domain-Name: Default Jun 29 08:04:22.830232 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Project-Id: f46c6cdc3217456dba6eda8ff23e9f3a Jun 29 08:04:22.830232 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Project-Name: tempest-DeleteServersTestJSON-1859056524 Jun 29 08:04:22.830232 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Role: member,reader Jun 29 08:04:22.830232 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Roles: member,reader Jun 29 08:04:22.832049 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f46c6cdc3217456dba6eda8ff23e9f3a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_f46c6cdc3217456dba6eda8ff23e9f3a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f46c6cdc3217456dba6eda8ff23e9f3a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/f46c6cdc3217456dba6eda8ff23e9f3a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Jun 29 08:04:22.832049 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Tenant: tempest-DeleteServersTestJSON-1859056524 Jun 29 08:04:22.832049 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Tenant-Id: f46c6cdc3217456dba6eda8ff23e9f3a Jun 29 08:04:22.832049 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Tenant-Name: tempest-DeleteServersTestJSON-1859056524 Jun 29 08:04:22.832049 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-User: tempest-DeleteServersTestJSON-1859056524-project Jun 29 08:04:22.832049 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-User-Domain-Id: default Jun 29 08:04:22.832049 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-User-Domain-Name: Default Jun 29 08:04:22.832049 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-User-Id: 0800a22846504b0d9c49e1520a69e45b Jun 29 08:04:22.832049 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-User-Name: tempest-DeleteServersTestJSON-1859056524-project Jun 29 08:04:22.832049 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: method: > Jun 29 08:04:22.832049 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: exception: Instance b4774888-237c-41c5-8c79-7a6e34d17d70 could not be found. Jun 29 08:04:22.832049 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: action_args: {'id': 'b4774888-237c-41c5-8c79-7a6e34d17d70'} Jun 29 08:04:22.834061 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 08:04:22.834061 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:04:22.834061 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 29 08:04:22.834061 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 29 08:04:22.834061 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 29 08:04:22.834061 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 29 08:04:22.834061 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 29 08:04:22.834061 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 29 08:04:22.834061 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 29 08:04:22.834061 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 29 08:04:22.834061 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b4774888-237c-41c5-8c79-7a6e34d17d70 could not be found. Jun 29 08:04:22.834061 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 29 08:04:22.834061 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 08:04:22.834061 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 29 08:04:22.834061 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:04:22.834061 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 08:04:22.834061 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 08:04:22.834061 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 08:04:22.834061 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 08:04:22.834061 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 08:04:22.836288 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 08:04:22.836288 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 29 08:04:22.836288 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 29 08:04:22.836288 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 29 08:04:22.836288 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 29 08:04:22.836288 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 29 08:04:22.836288 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 29 08:04:22.836288 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b4774888-237c-41c5-8c79-7a6e34d17d70 could not be found. Jun 29 08:04:22.836288 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 29 08:04:22.836288 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 08:04:22.836288 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 29 08:04:22.836288 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:04:22.836288 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 08:04:22.836288 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 08:04:22.836288 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 08:04:22.836288 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 08:04:22.836288 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b4774888-237c-41c5-8c79-7a6e34d17d70 could not be found. Jun 29 08:04:22.836288 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 29 08:04:22.838265 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-7e9adfed-8430-4756-827b-0e4b1b30b4e0 tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] Returning 404 to user: Instance b4774888-237c-41c5-8c79-7a6e34d17d70 could not be found. {{(pid=117890) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 08:04:22.838265 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-7e9adfed-8430-4756-827b-0e4b1b30b4e0 tempest-DeleteServersTestJSON-1859056524 tempest-DeleteServersTestJSON-1859056524-project] 10.222.0.43 "GET /compute/v2.1/servers/b4774888-237c-41c5-8c79-7a6e34d17d70" status: 404 len: 111 microversion: 2.1 time: 0.043864 Jun 29 08:04:22.838265 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 70/144] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:04:22 2022] GET /compute/v2.1/servers/b4774888-237c-41c5-8c79-7a6e34d17d70 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 29 08:04:23.313481 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-e338c1f5-a8eb-49de-af1a-a5a800310d87 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4af4eedee24897be2e702ef51873b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab693125979f4bb7b7b3c94061610fe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:04:23.330567 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-e338c1f5-a8eb-49de-af1a-a5a800310d87 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] 10.222.0.43 "GET /compute/v2.1/servers/4f1bbb36-8695-4b09-9f25-bfc92ad06a86" status: 200 len: 1519 microversion: 2.1 time: 0.661793 Jun 29 08:04:23.331598 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 75/145] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:04:22 2022] GET /compute/v2.1/servers/4f1bbb36-8695-4b09-9f25-bfc92ad06a86 => generated 1519 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 08:04:24.359485 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-1f5e6eb2-e412-4804-9a8f-cd50e0d30ae3 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:04:24.361744 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-1f5e6eb2-e412-4804-9a8f-cd50e0d30ae3 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] [instance: 4f1bbb36-8695-4b09-9f25-bfc92ad06a86] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:04:24.370413 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-1f5e6eb2-e412-4804-9a8f-cd50e0d30ae3 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:04:24.371236 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-1f5e6eb2-e412-4804-9a8f-cd50e0d30ae3 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:04:24.372303 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-1f5e6eb2-e412-4804-9a8f-cd50e0d30ae3 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:04:24.373003 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-1f5e6eb2-e412-4804-9a8f-cd50e0d30ae3 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:04:24.616596 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-1f5e6eb2-e412-4804-9a8f-cd50e0d30ae3 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4af4eedee24897be2e702ef51873b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab693125979f4bb7b7b3c94061610fe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:04:24.631300 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-1f5e6eb2-e412-4804-9a8f-cd50e0d30ae3 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] 10.222.0.43 "GET /compute/v2.1/servers/4f1bbb36-8695-4b09-9f25-bfc92ad06a86" status: 200 len: 1519 microversion: 2.1 time: 0.286668 Jun 29 08:04:24.633412 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 71/146] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:04:24 2022] GET /compute/v2.1/servers/4f1bbb36-8695-4b09-9f25-bfc92ad06a86 => generated 1519 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:04:25.653493 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-f349fb3e-6ef6-4a76-845e-ed246c56ca4e tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:04:25.653493 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-f349fb3e-6ef6-4a76-845e-ed246c56ca4e tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] [instance: 4f1bbb36-8695-4b09-9f25-bfc92ad06a86] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:04:25.660019 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-f349fb3e-6ef6-4a76-845e-ed246c56ca4e tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:04:25.660599 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-f349fb3e-6ef6-4a76-845e-ed246c56ca4e tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:04:25.662151 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-f349fb3e-6ef6-4a76-845e-ed246c56ca4e tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:04:25.662873 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-f349fb3e-6ef6-4a76-845e-ed246c56ca4e tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:04:25.858811 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-f349fb3e-6ef6-4a76-845e-ed246c56ca4e tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4af4eedee24897be2e702ef51873b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab693125979f4bb7b7b3c94061610fe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:04:25.871920 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-f349fb3e-6ef6-4a76-845e-ed246c56ca4e tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] 10.222.0.43 "GET /compute/v2.1/servers/4f1bbb36-8695-4b09-9f25-bfc92ad06a86" status: 200 len: 1519 microversion: 2.1 time: 0.224987 Jun 29 08:04:25.873296 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 76/147] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:04:25 2022] GET /compute/v2.1/servers/4f1bbb36-8695-4b09-9f25-bfc92ad06a86 => generated 1519 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:04:26.899444 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-92652acc-5782-4e37-a126-a1ed86cd9732 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:04:26.902717 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-92652acc-5782-4e37-a126-a1ed86cd9732 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] [instance: 4f1bbb36-8695-4b09-9f25-bfc92ad06a86] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:04:26.915542 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-92652acc-5782-4e37-a126-a1ed86cd9732 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:04:26.917077 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-92652acc-5782-4e37-a126-a1ed86cd9732 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:04:26.919515 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-92652acc-5782-4e37-a126-a1ed86cd9732 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:04:26.920908 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-92652acc-5782-4e37-a126-a1ed86cd9732 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:04:27.391296 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-92652acc-5782-4e37-a126-a1ed86cd9732 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4af4eedee24897be2e702ef51873b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab693125979f4bb7b7b3c94061610fe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:04:27.404597 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-92652acc-5782-4e37-a126-a1ed86cd9732 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] 10.222.0.43 "GET /compute/v2.1/servers/4f1bbb36-8695-4b09-9f25-bfc92ad06a86" status: 200 len: 1519 microversion: 2.1 time: 0.515125 Jun 29 08:04:27.405236 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 72/148] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:04:26 2022] GET /compute/v2.1/servers/4f1bbb36-8695-4b09-9f25-bfc92ad06a86 => generated 1519 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:04:28.448299 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-659642b4-10ac-4258-bf5a-2148b58057c0 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:04:28.449076 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-659642b4-10ac-4258-bf5a-2148b58057c0 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] [instance: 4f1bbb36-8695-4b09-9f25-bfc92ad06a86] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:04:28.466605 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-659642b4-10ac-4258-bf5a-2148b58057c0 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:04:28.470440 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-659642b4-10ac-4258-bf5a-2148b58057c0 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:04:28.471488 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-659642b4-10ac-4258-bf5a-2148b58057c0 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:04:28.473123 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-659642b4-10ac-4258-bf5a-2148b58057c0 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:04:28.830372 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-659642b4-10ac-4258-bf5a-2148b58057c0 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4af4eedee24897be2e702ef51873b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab693125979f4bb7b7b3c94061610fe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:04:28.844252 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-659642b4-10ac-4258-bf5a-2148b58057c0 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] 10.222.0.43 "GET /compute/v2.1/servers/4f1bbb36-8695-4b09-9f25-bfc92ad06a86" status: 200 len: 1519 microversion: 2.1 time: 0.411279 Jun 29 08:04:28.849946 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 77/149] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:04:28 2022] GET /compute/v2.1/servers/4f1bbb36-8695-4b09-9f25-bfc92ad06a86 => generated 1519 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:04:29.865997 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-edaf1cc9-a747-46a1-baf1-812b121246ee tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:04:29.867608 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-edaf1cc9-a747-46a1-baf1-812b121246ee tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] [instance: 4f1bbb36-8695-4b09-9f25-bfc92ad06a86] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:04:29.875219 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-edaf1cc9-a747-46a1-baf1-812b121246ee tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:04:29.875791 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-edaf1cc9-a747-46a1-baf1-812b121246ee tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:04:29.876624 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-edaf1cc9-a747-46a1-baf1-812b121246ee tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:04:29.877095 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-edaf1cc9-a747-46a1-baf1-812b121246ee tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:04:30.238078 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-edaf1cc9-a747-46a1-baf1-812b121246ee tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4af4eedee24897be2e702ef51873b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab693125979f4bb7b7b3c94061610fe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:04:30.257683 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-edaf1cc9-a747-46a1-baf1-812b121246ee tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] 10.222.0.43 "GET /compute/v2.1/servers/4f1bbb36-8695-4b09-9f25-bfc92ad06a86" status: 200 len: 1499 microversion: 2.1 time: 0.397041 Jun 29 08:04:30.271032 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 73/150] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:04:29 2022] GET /compute/v2.1/servers/4f1bbb36-8695-4b09-9f25-bfc92ad06a86 => generated 1499 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:04:30.299828 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-64af1084-f6f0-4334-b25d-1e576ffbb172 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:04:30.302710 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-64af1084-f6f0-4334-b25d-1e576ffbb172 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] [instance: 79765057-c430-4292-bc5f-ee0c6a66b367] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:04:30.327959 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_api:SELECT=38 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:04:30.339027 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-64af1084-f6f0-4334-b25d-1e576ffbb172 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:04:30.353862 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-64af1084-f6f0-4334-b25d-1e576ffbb172 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:04:30.355833 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-64af1084-f6f0-4334-b25d-1e576ffbb172 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:04:30.357935 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-64af1084-f6f0-4334-b25d-1e576ffbb172 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:04:30.864846 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-64af1084-f6f0-4334-b25d-1e576ffbb172 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4af4eedee24897be2e702ef51873b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab693125979f4bb7b7b3c94061610fe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:04:30.892388 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-64af1084-f6f0-4334-b25d-1e576ffbb172 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] 10.222.0.43 "GET /compute/v2.1/servers/79765057-c430-4292-bc5f-ee0c6a66b367" status: 200 len: 1516 microversion: 2.1 time: 0.607644 Jun 29 08:04:30.898178 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 78/151] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:04:30 2022] GET /compute/v2.1/servers/79765057-c430-4292-bc5f-ee0c6a66b367 => generated 1516 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:04:32.544098 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-c96a9f30-7313-4827-9384-856dac45cd9c tempest-VolumesSnapshotsTestJSON-1495727199 tempest-VolumesSnapshotsTestJSON-1495727199-project] Action: 'create', calling method: .version_select at 0x7f72416d49d0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1752420890"}} {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:04:32.734460 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-54454601-9ea8-4c43-8049-690ae8abc924 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:04:32.735884 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-54454601-9ea8-4c43-8049-690ae8abc924 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] [instance: 79765057-c430-4292-bc5f-ee0c6a66b367] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:04:32.746177 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-54454601-9ea8-4c43-8049-690ae8abc924 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:04:32.746631 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-54454601-9ea8-4c43-8049-690ae8abc924 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:04:32.747428 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-54454601-9ea8-4c43-8049-690ae8abc924 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:04:32.747865 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-54454601-9ea8-4c43-8049-690ae8abc924 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:04:32.789321 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.objects.instance [None req-54454601-9ea8-4c43-8049-690ae8abc924 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lazy-loading 'flavor' on Instance uuid 79765057-c430-4292-bc5f-ee0c6a66b367 {{(pid=117889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 29 08:04:32.961644 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-54454601-9ea8-4c43-8049-690ae8abc924 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] 10.222.0.43 "POST /compute/v2.1/servers/79765057-c430-4292-bc5f-ee0c6a66b367/action" status: 200 len: 32 microversion: 2.1 time: 0.232074 Jun 29 08:04:32.972233 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 79/152] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Jun 29 08:04:32 2022] POST /compute/v2.1/servers/79765057-c430-4292-bc5f-ee0c6a66b367/action => generated 32 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 29 08:04:32.984551 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-f3081846-9709-42a9-b587-59b04730a69d tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:04:32.986637 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-f3081846-9709-42a9-b587-59b04730a69d tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] [instance: 79765057-c430-4292-bc5f-ee0c6a66b367] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:04:33.000750 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-f3081846-9709-42a9-b587-59b04730a69d tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:04:33.002605 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-f3081846-9709-42a9-b587-59b04730a69d tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:04:33.005774 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-f3081846-9709-42a9-b587-59b04730a69d tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:04:33.006848 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-f3081846-9709-42a9-b587-59b04730a69d tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:04:33.316542 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-c96a9f30-7313-4827-9384-856dac45cd9c tempest-VolumesSnapshotsTestJSON-1495727199 tempest-VolumesSnapshotsTestJSON-1495727199-project] 10.222.0.43 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.960451 Jun 29 08:04:33.318174 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 74/153] 10.222.0.43 () {60 vars in 1154 bytes} [Wed Jun 29 08:04:32 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 963 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Jun 29 08:04:33.346325 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-45ecec78-fcdb-4822-9de1-c56940926620 tempest-VolumesSnapshotsTestJSON-1495727199 tempest-VolumesSnapshotsTestJSON-1495727199-project] Calling method '.version_select at 0x7f72417bb5e0>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:04:33.350528 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-f3081846-9709-42a9-b587-59b04730a69d tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4af4eedee24897be2e702ef51873b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab693125979f4bb7b7b3c94061610fe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:04:33.363154 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-f3081846-9709-42a9-b587-59b04730a69d tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] 10.222.0.43 "GET /compute/v2.1/servers/79765057-c430-4292-bc5f-ee0c6a66b367" status: 200 len: 1522 microversion: 2.1 time: 0.386498 Jun 29 08:04:33.376133 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 80/154] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:04:32 2022] GET /compute/v2.1/servers/79765057-c430-4292-bc5f-ee0c6a66b367 => generated 1522 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:04:33.462032 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-45ecec78-fcdb-4822-9de1-c56940926620 tempest-VolumesSnapshotsTestJSON-1495727199 tempest-VolumesSnapshotsTestJSON-1495727199-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/2d154e89-c57e-43b5-8d63-a6d60c2ee0b0" status: 200 len: 345 microversion: 2.1 time: 0.128635 Jun 29 08:04:33.463092 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 75/155] 10.222.0.43 () {58 vars in 1244 bytes} [Wed Jun 29 08:04:33 2022] GET /compute/v2.1/os-volumes/2d154e89-c57e-43b5-8d63-a6d60c2ee0b0 => generated 345 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:04:33.869779 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-357c94fc-3eb9-48d5-b9e4-260cf2496a9b tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-691399153", "imageRef": "5d2148a0-3628-4eff-88e9-5686abc0d33e", "flavorRef": "452", "networks": [{"uuid": "bb0ac50d-f096-456e-83b5-ef7555b20457"}]}} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:04:33.971664 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.network.neutron [None req-357c94fc-3eb9-48d5-b9e4-260cf2496a9b tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] validate_networks() for [('bb0ac50d-f096-456e-83b5-ef7555b20457', None, None, None, None, None)] {{(pid=117889) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 29 08:04:34.388326 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-7c883345-cd88-4caf-82df-ff96a2d070ca tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:04:34.390550 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-7c883345-cd88-4caf-82df-ff96a2d070ca tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] [instance: 79765057-c430-4292-bc5f-ee0c6a66b367] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:04:34.403052 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-7c883345-cd88-4caf-82df-ff96a2d070ca tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:04:34.404545 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-7c883345-cd88-4caf-82df-ff96a2d070ca tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:04:34.406465 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-7c883345-cd88-4caf-82df-ff96a2d070ca tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:04:34.407674 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-7c883345-cd88-4caf-82df-ff96a2d070ca tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:04:34.798668 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-7c883345-cd88-4caf-82df-ff96a2d070ca tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4af4eedee24897be2e702ef51873b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab693125979f4bb7b7b3c94061610fe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:04:34.821477 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-7c883345-cd88-4caf-82df-ff96a2d070ca tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] 10.222.0.43 "GET /compute/v2.1/servers/79765057-c430-4292-bc5f-ee0c6a66b367" status: 200 len: 1522 microversion: 2.1 time: 0.441853 Jun 29 08:04:34.822468 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 76/156] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:04:34 2022] GET /compute/v2.1/servers/79765057-c430-4292-bc5f-ee0c6a66b367 => generated 1522 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 08:04:34.855766 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-4ce8da51-2eed-4f2f-94af-b6648f172e07 tempest-VolumesSnapshotsTestJSON-1495727199 tempest-VolumesSnapshotsTestJSON-1495727199-project] Calling method '.version_select at 0x7f724169eaf0>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:04:35.003019 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.virt.hardware [None req-357c94fc-3eb9-48d5-b9e4-260cf2496a9b tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Flavor limits 0:0:0 {{(pid=117889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 29 08:04:35.004304 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.virt.hardware [None req-357c94fc-3eb9-48d5-b9e4-260cf2496a9b tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Image limits 0:0:0 {{(pid=117889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 29 08:04:35.005751 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.virt.hardware [None req-357c94fc-3eb9-48d5-b9e4-260cf2496a9b tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Flavor pref 0:0:0 {{(pid=117889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 29 08:04:35.006625 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.virt.hardware [None req-357c94fc-3eb9-48d5-b9e4-260cf2496a9b tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Image pref 0:0:0 {{(pid=117889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 29 08:04:35.007816 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.virt.hardware [None req-357c94fc-3eb9-48d5-b9e4-260cf2496a9b tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 29 08:04:35.019815 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-4ce8da51-2eed-4f2f-94af-b6648f172e07 tempest-VolumesSnapshotsTestJSON-1495727199 tempest-VolumesSnapshotsTestJSON-1495727199-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/2d154e89-c57e-43b5-8d63-a6d60c2ee0b0" status: 200 len: 346 microversion: 2.1 time: 0.176288 Jun 29 08:04:35.021782 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 77/157] 10.222.0.43 () {58 vars in 1244 bytes} [Wed Jun 29 08:04:34 2022] GET /compute/v2.1/os-volumes/2d154e89-c57e-43b5-8d63-a6d60c2ee0b0 => generated 346 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:04:35.023725 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-357c94fc-3eb9-48d5-b9e4-260cf2496a9b tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:04:35.024548 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-357c94fc-3eb9-48d5-b9e4-260cf2496a9b tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:04:35.025684 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-357c94fc-3eb9-48d5-b9e4-260cf2496a9b tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:04:35.026328 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-357c94fc-3eb9-48d5-b9e4-260cf2496a9b tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:04:35.048814 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-108eb932-4976-4c8e-80b9-a8f351f1d9d7 tempest-VolumesSnapshotsTestJSON-1495727199 tempest-VolumesSnapshotsTestJSON-1495727199-project] Action: 'create', calling method: .version_select at 0x7f724169e790>, body: {"snapshot": {"volume_id": "2d154e89-c57e-43b5-8d63-a6d60c2ee0b0", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-709722330"}} {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:04:35.062872 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.quota [None req-357c94fc-3eb9-48d5-b9e4-260cf2496a9b tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Getting quotas for project 7bdadf97d44048c3bec51c0ae58ee4a6. Resources: {'ram', 'instances', 'cores'} {{(pid=117889) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 29 08:04:35.073246 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.quota [None req-357c94fc-3eb9-48d5-b9e4-260cf2496a9b tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Getting quotas for user c1feaba97f594ffda9dd2962bebdc082 and project 7bdadf97d44048c3bec51c0ae58ee4a6. Resources: {'ram', 'instances', 'cores'} {{(pid=117889) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 29 08:04:35.093903 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-357c94fc-3eb9-48d5-b9e4-260cf2496a9b tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Going to run 1 instances... {{(pid=117889) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 29 08:04:35.097241 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-357c94fc-3eb9-48d5-b9e4-260cf2496a9b tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] [instance: 2e99307a-e437-4e8d-821c-319cc555e209] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5d2148a0-3628-4eff-88e9-5686abc0d33e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117889) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 29 08:04:35.193486 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-357c94fc-3eb9-48d5-b9e4-260cf2496a9b tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.328104 Jun 29 08:04:35.194977 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 81/158] 10.222.0.43 () {60 vars in 1146 bytes} [Wed Jun 29 08:04:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 1331 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 29 08:04:35.210426 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-069b0672-3b4e-41ba-9169-483b92687106 tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:04:35.211353 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-069b0672-3b4e-41ba-9169-483b92687106 tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] [instance: 2e99307a-e437-4e8d-821c-319cc555e209] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:04:35.384746 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-069b0672-3b4e-41ba-9169-483b92687106 tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1feaba97f594ffda9dd2962bebdc082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdadf97d44048c3bec51c0ae58ee4a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:04:35.396140 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-069b0672-3b4e-41ba-9169-483b92687106 tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] 10.222.0.43 "GET /compute/v2.1/servers/2e99307a-e437-4e8d-821c-319cc555e209" status: 200 len: 1218 microversion: 2.1 time: 0.192032 Jun 29 08:04:35.399539 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 82/159] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:04:35 2022] GET /compute/v2.1/servers/2e99307a-e437-4e8d-821c-319cc555e209 => generated 1218 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:04:35.460666 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-108eb932-4976-4c8e-80b9-a8f351f1d9d7 tempest-VolumesSnapshotsTestJSON-1495727199 tempest-VolumesSnapshotsTestJSON-1495727199-project] 10.222.0.43 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.421993 Jun 29 08:04:35.472562 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 78/160] 10.222.0.43 () {60 vars in 1161 bytes} [Wed Jun 29 08:04:35 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:04:35.478959 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-fb4694b0-ca77-4ce8-8e27-96faac2382e8 tempest-VolumesSnapshotsTestJSON-1495727199 tempest-VolumesSnapshotsTestJSON-1495727199-project] Calling method '.version_select at 0x7f7241607b80>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:04:35.702261 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-fb4694b0-ca77-4ce8-8e27-96faac2382e8 tempest-VolumesSnapshotsTestJSON-1495727199 tempest-VolumesSnapshotsTestJSON-1495727199-project] 10.222.0.43 "GET /compute/v2.1/os-snapshots/6a3dd023-faa2-40df-9f5c-668c5eb7a258" status: 200 len: 286 microversion: 2.1 time: 0.228282 Jun 29 08:04:35.703793 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 83/161] 10.222.0.43 () {58 vars in 1250 bytes} [Wed Jun 29 08:04:35 2022] GET /compute/v2.1/os-snapshots/6a3dd023-faa2-40df-9f5c-668c5eb7a258 => generated 286 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:04:35.719233 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-53fe7ab4-41e4-4f0e-b330-8dca38e93639 tempest-VolumesSnapshotsTestJSON-1495727199 tempest-VolumesSnapshotsTestJSON-1495727199-project] Calling method '.version_select at 0x7f7241638040>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:04:35.820238 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-53fe7ab4-41e4-4f0e-b330-8dca38e93639 tempest-VolumesSnapshotsTestJSON-1495727199 tempest-VolumesSnapshotsTestJSON-1495727199-project] 10.222.0.43 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.097870 Jun 29 08:04:35.821165 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 79/162] 10.222.0.43 () {58 vars in 1139 bytes} [Wed Jun 29 08:04:35 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:04:35.858695 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-e0bc73fb-54c2-4073-a0cd-5381a6d6f399 tempest-VolumesSnapshotsTestJSON-1495727199 tempest-VolumesSnapshotsTestJSON-1495727199-project] Calling method '.version_select at 0x7f7241581b80>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:04:35.863318 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-360f415c-68dd-45d0-be42-f06f9a43f003 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:04:35.867144 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-360f415c-68dd-45d0-be42-f06f9a43f003 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] [instance: 79765057-c430-4292-bc5f-ee0c6a66b367] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:04:35.900444 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-360f415c-68dd-45d0-be42-f06f9a43f003 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:04:35.902956 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-360f415c-68dd-45d0-be42-f06f9a43f003 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:04:35.908245 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-360f415c-68dd-45d0-be42-f06f9a43f003 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:04:35.912088 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-360f415c-68dd-45d0-be42-f06f9a43f003 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:04:35.994947 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-e0bc73fb-54c2-4073-a0cd-5381a6d6f399 tempest-VolumesSnapshotsTestJSON-1495727199 tempest-VolumesSnapshotsTestJSON-1495727199-project] 10.222.0.43 "GET /compute/v2.1/os-snapshots/6a3dd023-faa2-40df-9f5c-668c5eb7a258" status: 200 len: 286 microversion: 2.1 time: 0.161567 Jun 29 08:04:36.004456 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 84/163] 10.222.0.43 () {58 vars in 1250 bytes} [Wed Jun 29 08:04:35 2022] GET /compute/v2.1/os-snapshots/6a3dd023-faa2-40df-9f5c-668c5eb7a258 => generated 286 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:04:36.383929 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-360f415c-68dd-45d0-be42-f06f9a43f003 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4af4eedee24897be2e702ef51873b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab693125979f4bb7b7b3c94061610fe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:04:36.397080 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-360f415c-68dd-45d0-be42-f06f9a43f003 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] 10.222.0.43 "GET /compute/v2.1/servers/79765057-c430-4292-bc5f-ee0c6a66b367" status: 200 len: 1522 microversion: 2.1 time: 0.559786 Jun 29 08:04:36.399454 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 80/164] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:04:35 2022] GET /compute/v2.1/servers/79765057-c430-4292-bc5f-ee0c6a66b367 => generated 1522 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:04:36.417174 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-b2c6b75a-655c-491c-923d-4c33ef62256e tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:04:36.418132 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-b2c6b75a-655c-491c-923d-4c33ef62256e tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] [instance: 2e99307a-e437-4e8d-821c-319cc555e209] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:04:36.431974 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-b2c6b75a-655c-491c-923d-4c33ef62256e tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:04:36.432526 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-b2c6b75a-655c-491c-923d-4c33ef62256e tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:04:36.433279 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-b2c6b75a-655c-491c-923d-4c33ef62256e tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:04:36.433708 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-b2c6b75a-655c-491c-923d-4c33ef62256e tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:04:36.600030 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-b2c6b75a-655c-491c-923d-4c33ef62256e tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1feaba97f594ffda9dd2962bebdc082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdadf97d44048c3bec51c0ae58ee4a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:04:36.613302 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-b2c6b75a-655c-491c-923d-4c33ef62256e tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] 10.222.0.43 "GET /compute/v2.1/servers/2e99307a-e437-4e8d-821c-319cc555e209" status: 200 len: 1222 microversion: 2.1 time: 0.200189 Jun 29 08:04:36.615095 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 85/165] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:04:36 2022] GET /compute/v2.1/servers/2e99307a-e437-4e8d-821c-319cc555e209 => generated 1222 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:04:37.032210 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-16ba48a8-5e28-4c81-a9e6-b7f671c306f2 tempest-VolumesSnapshotsTestJSON-1495727199 tempest-VolumesSnapshotsTestJSON-1495727199-project] Calling method '.version_select at 0x7f724169e1f0>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:04:37.116074 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-16ba48a8-5e28-4c81-a9e6-b7f671c306f2 tempest-VolumesSnapshotsTestJSON-1495727199 tempest-VolumesSnapshotsTestJSON-1495727199-project] 10.222.0.43 "GET /compute/v2.1/os-snapshots/6a3dd023-faa2-40df-9f5c-668c5eb7a258" status: 200 len: 286 microversion: 2.1 time: 0.108759 Jun 29 08:04:37.117082 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 81/166] 10.222.0.43 () {58 vars in 1250 bytes} [Wed Jun 29 08:04:37 2022] GET /compute/v2.1/os-snapshots/6a3dd023-faa2-40df-9f5c-668c5eb7a258 => generated 286 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:04:37.416971 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-2c8d0e2f-b6d6-433e-ad3c-86cd8641df4d tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:04:37.417702 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-2c8d0e2f-b6d6-433e-ad3c-86cd8641df4d tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] [instance: 79765057-c430-4292-bc5f-ee0c6a66b367] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:04:37.434046 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-2c8d0e2f-b6d6-433e-ad3c-86cd8641df4d tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:04:37.434880 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-2c8d0e2f-b6d6-433e-ad3c-86cd8641df4d tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:04:37.436540 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-2c8d0e2f-b6d6-433e-ad3c-86cd8641df4d tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:04:37.437371 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-2c8d0e2f-b6d6-433e-ad3c-86cd8641df4d tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:04:37.643232 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-eb1d393b-a2a7-414f-870e-b3fea7858d42 tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:04:37.644047 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-eb1d393b-a2a7-414f-870e-b3fea7858d42 tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] [instance: 2e99307a-e437-4e8d-821c-319cc555e209] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:04:37.655670 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-2c8d0e2f-b6d6-433e-ad3c-86cd8641df4d tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4af4eedee24897be2e702ef51873b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab693125979f4bb7b7b3c94061610fe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:04:37.656886 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-eb1d393b-a2a7-414f-870e-b3fea7858d42 tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:04:37.657406 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-eb1d393b-a2a7-414f-870e-b3fea7858d42 tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:04:37.663225 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-eb1d393b-a2a7-414f-870e-b3fea7858d42 tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:04:37.664463 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-eb1d393b-a2a7-414f-870e-b3fea7858d42 tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:04:37.665923 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-2c8d0e2f-b6d6-433e-ad3c-86cd8641df4d tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] 10.222.0.43 "GET /compute/v2.1/servers/79765057-c430-4292-bc5f-ee0c6a66b367" status: 200 len: 1522 microversion: 2.1 time: 0.252626 Jun 29 08:04:37.666521 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 86/167] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:04:37 2022] GET /compute/v2.1/servers/79765057-c430-4292-bc5f-ee0c6a66b367 => generated 1522 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 08:04:37.810646 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-eb1d393b-a2a7-414f-870e-b3fea7858d42 tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1feaba97f594ffda9dd2962bebdc082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdadf97d44048c3bec51c0ae58ee4a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:04:37.831733 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-eb1d393b-a2a7-414f-870e-b3fea7858d42 tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] 10.222.0.43 "GET /compute/v2.1/servers/2e99307a-e437-4e8d-821c-319cc555e209" status: 200 len: 1222 microversion: 2.1 time: 0.195137 Jun 29 08:04:37.834329 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 82/168] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:04:37 2022] GET /compute/v2.1/servers/2e99307a-e437-4e8d-821c-319cc555e209 => generated 1222 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:04:38.154279 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-65c3a042-4782-4a6a-804f-468a5e1092f8 tempest-VolumesSnapshotsTestJSON-1495727199 tempest-VolumesSnapshotsTestJSON-1495727199-project] Calling method '.version_select at 0x7f72415988b0>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:04:38.269408 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-65c3a042-4782-4a6a-804f-468a5e1092f8 tempest-VolumesSnapshotsTestJSON-1495727199 tempest-VolumesSnapshotsTestJSON-1495727199-project] 10.222.0.43 "GET /compute/v2.1/os-snapshots/6a3dd023-faa2-40df-9f5c-668c5eb7a258" status: 200 len: 286 microversion: 2.1 time: 0.137444 Jun 29 08:04:38.270002 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 87/169] 10.222.0.43 () {58 vars in 1250 bytes} [Wed Jun 29 08:04:38 2022] GET /compute/v2.1/os-snapshots/6a3dd023-faa2-40df-9f5c-668c5eb7a258 => generated 286 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:04:38.703634 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-50d6127c-084c-4973-a8c0-38fec66d8558 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:04:38.708764 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-50d6127c-084c-4973-a8c0-38fec66d8558 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] [instance: 79765057-c430-4292-bc5f-ee0c6a66b367] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:04:38.727586 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-50d6127c-084c-4973-a8c0-38fec66d8558 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:04:38.730352 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-50d6127c-084c-4973-a8c0-38fec66d8558 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:04:38.732581 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-50d6127c-084c-4973-a8c0-38fec66d8558 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:04:38.734055 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-50d6127c-084c-4973-a8c0-38fec66d8558 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:04:38.864741 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-6da7eb8e-d601-4c16-a1dd-dc6ec4f64e15 tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:04:38.871104 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-6da7eb8e-d601-4c16-a1dd-dc6ec4f64e15 tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] [instance: 2e99307a-e437-4e8d-821c-319cc555e209] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:04:38.905903 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-6da7eb8e-d601-4c16-a1dd-dc6ec4f64e15 tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:04:38.907329 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-6da7eb8e-d601-4c16-a1dd-dc6ec4f64e15 tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:04:38.910221 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-6da7eb8e-d601-4c16-a1dd-dc6ec4f64e15 tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:04:38.911498 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-6da7eb8e-d601-4c16-a1dd-dc6ec4f64e15 tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:04:39.065716 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-6da7eb8e-d601-4c16-a1dd-dc6ec4f64e15 tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1feaba97f594ffda9dd2962bebdc082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdadf97d44048c3bec51c0ae58ee4a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:04:39.080155 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-6da7eb8e-d601-4c16-a1dd-dc6ec4f64e15 tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] 10.222.0.43 "GET /compute/v2.1/servers/2e99307a-e437-4e8d-821c-319cc555e209" status: 200 len: 1270 microversion: 2.1 time: 0.229324 Jun 29 08:04:39.081493 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 88/170] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:04:38 2022] GET /compute/v2.1/servers/2e99307a-e437-4e8d-821c-319cc555e209 => generated 1270 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 08:04:39.121130 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-50d6127c-084c-4973-a8c0-38fec66d8558 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4af4eedee24897be2e702ef51873b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab693125979f4bb7b7b3c94061610fe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:04:39.133901 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-50d6127c-084c-4973-a8c0-38fec66d8558 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] 10.222.0.43 "GET /compute/v2.1/servers/79765057-c430-4292-bc5f-ee0c6a66b367" status: 200 len: 1522 microversion: 2.1 time: 0.441601 Jun 29 08:04:39.134769 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 83/171] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:04:38 2022] GET /compute/v2.1/servers/79765057-c430-4292-bc5f-ee0c6a66b367 => generated 1522 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:04:39.293399 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-c1ced14a-3bb7-457a-b214-376eb9e0280c tempest-VolumesSnapshotsTestJSON-1495727199 tempest-VolumesSnapshotsTestJSON-1495727199-project] Calling method '.version_select at 0x7f7241598c10>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:04:39.413479 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-c1ced14a-3bb7-457a-b214-376eb9e0280c tempest-VolumesSnapshotsTestJSON-1495727199 tempest-VolumesSnapshotsTestJSON-1495727199-project] 10.222.0.43 "GET /compute/v2.1/os-snapshots/6a3dd023-faa2-40df-9f5c-668c5eb7a258" status: 200 len: 287 microversion: 2.1 time: 0.134781 Jun 29 08:04:39.415496 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 89/172] 10.222.0.43 () {58 vars in 1250 bytes} [Wed Jun 29 08:04:39 2022] GET /compute/v2.1/os-snapshots/6a3dd023-faa2-40df-9f5c-668c5eb7a258 => generated 287 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:04:39.434673 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-b8a24f9d-8150-4fd2-bd56-38b0194a7228 tempest-VolumesSnapshotsTestJSON-1495727199 tempest-VolumesSnapshotsTestJSON-1495727199-project] Calling method '.version_select at 0x7f72415301f0>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:04:39.573027 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-b8a24f9d-8150-4fd2-bd56-38b0194a7228 tempest-VolumesSnapshotsTestJSON-1495727199 tempest-VolumesSnapshotsTestJSON-1495727199-project] 10.222.0.43 "DELETE /compute/v2.1/os-snapshots/6a3dd023-faa2-40df-9f5c-668c5eb7a258" status: 202 len: 0 microversion: 2.1 time: 0.145158 Jun 29 08:04:39.574280 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 84/173] 10.222.0.43 () {58 vars in 1253 bytes} [Wed Jun 29 08:04:39 2022] DELETE /compute/v2.1/os-snapshots/6a3dd023-faa2-40df-9f5c-668c5eb7a258 => generated 0 bytes in 148 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 29 08:04:39.590376 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-5d4ac04b-5b54-4a3f-a9c0-b4164e7869c0 tempest-VolumesSnapshotsTestJSON-1495727199 tempest-VolumesSnapshotsTestJSON-1495727199-project] Calling method '.version_select at 0x7f7241581ee0>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:04:39.676354 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-5d4ac04b-5b54-4a3f-a9c0-b4164e7869c0 tempest-VolumesSnapshotsTestJSON-1495727199 tempest-VolumesSnapshotsTestJSON-1495727199-project] 10.222.0.43 "GET /compute/v2.1/os-snapshots/6a3dd023-faa2-40df-9f5c-668c5eb7a258" status: 200 len: 286 microversion: 2.1 time: 0.092053 Jun 29 08:04:39.678960 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 90/174] 10.222.0.43 () {58 vars in 1250 bytes} [Wed Jun 29 08:04:39 2022] GET /compute/v2.1/os-snapshots/6a3dd023-faa2-40df-9f5c-668c5eb7a258 => generated 286 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 29 08:04:40.105405 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-fdc3086e-616a-4913-ab03-b2834e22e688 tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:04:40.111549 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-fdc3086e-616a-4913-ab03-b2834e22e688 tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] [instance: 2e99307a-e437-4e8d-821c-319cc555e209] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:04:40.136353 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-fdc3086e-616a-4913-ab03-b2834e22e688 tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:04:40.141817 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-fdc3086e-616a-4913-ab03-b2834e22e688 tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:04:40.146040 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-fdc3086e-616a-4913-ab03-b2834e22e688 tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:04:40.159401 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-52e21981-bbf6-443f-9c23-70c35d74fd9d tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:04:40.161775 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-fdc3086e-616a-4913-ab03-b2834e22e688 tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:04:40.165980 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-52e21981-bbf6-443f-9c23-70c35d74fd9d tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] [instance: 79765057-c430-4292-bc5f-ee0c6a66b367] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:04:40.199753 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-52e21981-bbf6-443f-9c23-70c35d74fd9d tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:04:40.200419 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-52e21981-bbf6-443f-9c23-70c35d74fd9d tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:04:40.212479 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-52e21981-bbf6-443f-9c23-70c35d74fd9d tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:04:40.215249 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-52e21981-bbf6-443f-9c23-70c35d74fd9d tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:04:40.516206 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-fdc3086e-616a-4913-ab03-b2834e22e688 tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1feaba97f594ffda9dd2962bebdc082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdadf97d44048c3bec51c0ae58ee4a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:04:40.532560 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-fdc3086e-616a-4913-ab03-b2834e22e688 tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] 10.222.0.43 "GET /compute/v2.1/servers/2e99307a-e437-4e8d-821c-319cc555e209" status: 200 len: 1276 microversion: 2.1 time: 0.436742 Jun 29 08:04:40.535927 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 85/175] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:04:40 2022] GET /compute/v2.1/servers/2e99307a-e437-4e8d-821c-319cc555e209 => generated 1276 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:04:40.695725 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-588165ed-f2b1-413a-b27d-21bc21ac5b2c tempest-VolumesSnapshotsTestJSON-1495727199 tempest-VolumesSnapshotsTestJSON-1495727199-project] Calling method '.version_select at 0x7f72415300d0>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:04:40.756382 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.wsgi [None req-588165ed-f2b1-413a-b27d-21bc21ac5b2c tempest-VolumesSnapshotsTestJSON-1495727199 tempest-VolumesSnapshotsTestJSON-1495727199-project] HTTP exception thrown: Snapshot 6a3dd023-faa2-40df-9f5c-668c5eb7a258 could not be found. Jun 29 08:04:40.761357 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-588165ed-f2b1-413a-b27d-21bc21ac5b2c tempest-VolumesSnapshotsTestJSON-1495727199 tempest-VolumesSnapshotsTestJSON-1495727199-project] Request method failure captured: Jun 29 08:04:40.761357 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: request: GET /compute/v2.1/os-snapshots/6a3dd023-faa2-40df-9f5c-668c5eb7a258 HTTP/1.1 Jun 29 08:04:40.761357 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: Accept: application/json Jun 29 08:04:40.761357 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: Accept-Encoding: identity Jun 29 08:04:40.761357 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: Connection: close Jun 29 08:04:40.761357 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: Content-Length: 0 Jun 29 08:04:40.761357 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: Content-Type: application/json Jun 29 08:04:40.761357 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: Host: 10.222.0.43 Jun 29 08:04:40.761357 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: Openstack-System-Scope: None Jun 29 08:04:40.761357 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: User-Agent: python-urllib3/1.26.9 Jun 29 08:04:40.761357 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Auth-Token: gAAAAABivAeQKNAKf13KU_Dxgnwz_Z-1-UiVlaY-41hVltVHpIvzK8j9aa6a-h0lwyOfaW9WDomPD-cVRx_g_r862lLBU36TcViO0LXT2FtnjznSsn7oZNuTjPr67hMwRX6RDaNBEaULWelStMtkuh1qvcpwAG6NB8-FLpCfKo3NxjOpW7cTdNw Jun 29 08:04:40.761357 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Domain-Id: None Jun 29 08:04:40.761357 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Domain-Name: None Jun 29 08:04:40.761357 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Identity-Status: Confirmed Jun 29 08:04:40.761357 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Is-Admin-Project: True Jun 29 08:04:40.761357 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Project-Domain-Id: default Jun 29 08:04:40.761357 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Project-Domain-Name: Default Jun 29 08:04:40.761357 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Project-Id: 69e2bbfe423846dc9755f233e89ecc8f Jun 29 08:04:40.761357 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1495727199 Jun 29 08:04:40.761357 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Role: member,reader Jun 29 08:04:40.761357 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Roles: member,reader Jun 29 08:04:40.762911 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/69e2bbfe423846dc9755f233e89ecc8f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_69e2bbfe423846dc9755f233e89ecc8f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/69e2bbfe423846dc9755f233e89ecc8f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/69e2bbfe423846dc9755f233e89ecc8f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Jun 29 08:04:40.762911 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1495727199 Jun 29 08:04:40.762911 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Tenant-Id: 69e2bbfe423846dc9755f233e89ecc8f Jun 29 08:04:40.762911 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1495727199 Jun 29 08:04:40.762911 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-User: tempest-VolumesSnapshotsTestJSON-1495727199-project Jun 29 08:04:40.762911 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-User-Domain-Id: default Jun 29 08:04:40.762911 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-User-Domain-Name: Default Jun 29 08:04:40.762911 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-User-Id: 719204a59b4c4344adb0d1b4c698003e Jun 29 08:04:40.762911 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1495727199-project Jun 29 08:04:40.762911 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: method: Jun 29 08:04:40.762911 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: exception: Snapshot 6a3dd023-faa2-40df-9f5c-668c5eb7a258 could not be found. Jun 29 08:04:40.762911 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: action_args: {'id': '6a3dd023-faa2-40df-9f5c-668c5eb7a258'} Jun 29 08:04:40.762911 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 08:04:40.763827 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:04:40.763827 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 29 08:04:40.763827 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 29 08:04:40.763827 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 29 08:04:40.763827 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 29 08:04:40.763827 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 29 08:04:40.763827 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 29 08:04:40.763827 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 29 08:04:40.763827 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 29 08:04:40.763827 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 29 08:04:40.763827 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 29 08:04:40.763827 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 29 08:04:40.763827 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 29 08:04:40.763827 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 29 08:04:40.763827 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 29 08:04:40.763827 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 6a3dd023-faa2-40df-9f5c-668c5eb7a258 could not be found. (HTTP 404) (Request-ID: req-788b03d3-7e86-43ae-8245-3ad17af94db0) Jun 29 08:04:40.763827 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 29 08:04:40.763827 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 08:04:40.765040 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 29 08:04:40.765040 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:04:40.765040 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jun 29 08:04:40.765040 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jun 29 08:04:40.765040 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 29 08:04:40.765040 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 29 08:04:40.765040 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jun 29 08:04:40.765040 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jun 29 08:04:40.765040 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 29 08:04:40.765040 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 29 08:04:40.765040 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 29 08:04:40.765040 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 29 08:04:40.765040 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 29 08:04:40.765040 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 29 08:04:40.765040 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 29 08:04:40.765040 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 29 08:04:40.765040 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 29 08:04:40.765040 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 29 08:04:40.765040 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 29 08:04:40.766246 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 29 08:04:40.766246 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 29 08:04:40.766246 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 29 08:04:40.766246 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 29 08:04:40.766246 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 29 08:04:40.766246 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 6a3dd023-faa2-40df-9f5c-668c5eb7a258 could not be found. Jun 29 08:04:40.766246 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 29 08:04:40.766246 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 08:04:40.766246 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 29 08:04:40.766246 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:04:40.766246 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 08:04:40.766246 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 08:04:40.766246 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 08:04:40.766246 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 08:04:40.766246 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 29 08:04:40.766246 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 29 08:04:40.766246 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 08:04:40.766246 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 08:04:40.766246 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jun 29 08:04:40.766246 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 29 08:04:40.767662 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 6a3dd023-faa2-40df-9f5c-668c5eb7a258 could not be found. Jun 29 08:04:40.767662 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 29 08:04:40.767662 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 08:04:40.767662 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 29 08:04:40.767662 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:04:40.767662 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 08:04:40.767662 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 08:04:40.767662 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 08:04:40.767662 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 08:04:40.767662 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 6a3dd023-faa2-40df-9f5c-668c5eb7a258 could not be found. Jun 29 08:04:40.767662 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 29 08:04:40.769622 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-588165ed-f2b1-413a-b27d-21bc21ac5b2c tempest-VolumesSnapshotsTestJSON-1495727199 tempest-VolumesSnapshotsTestJSON-1495727199-project] Returning 404 to user: Snapshot 6a3dd023-faa2-40df-9f5c-668c5eb7a258 could not be found. {{(pid=117890) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 08:04:40.775455 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-588165ed-f2b1-413a-b27d-21bc21ac5b2c tempest-VolumesSnapshotsTestJSON-1495727199 tempest-VolumesSnapshotsTestJSON-1495727199-project] 10.222.0.43 "GET /compute/v2.1/os-snapshots/6a3dd023-faa2-40df-9f5c-668c5eb7a258" status: 404 len: 111 microversion: 2.1 time: 0.082326 Jun 29 08:04:40.783615 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 86/176] 10.222.0.43 () {58 vars in 1250 bytes} [Wed Jun 29 08:04:40 2022] GET /compute/v2.1/os-snapshots/6a3dd023-faa2-40df-9f5c-668c5eb7a258 => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 29 08:04:40.795788 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-971b159e-44ed-4325-9c67-50ba4385bd41 tempest-VolumesSnapshotsTestJSON-1495727199 tempest-VolumesSnapshotsTestJSON-1495727199-project] Calling method '.version_select at 0x7f7241702dc0>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:04:40.960105 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-971b159e-44ed-4325-9c67-50ba4385bd41 tempest-VolumesSnapshotsTestJSON-1495727199 tempest-VolumesSnapshotsTestJSON-1495727199-project] 10.222.0.43 "DELETE /compute/v2.1/os-volumes/2d154e89-c57e-43b5-8d63-a6d60c2ee0b0" status: 202 len: 0 microversion: 2.1 time: 0.169691 Jun 29 08:04:40.963443 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 87/177] 10.222.0.43 () {58 vars in 1247 bytes} [Wed Jun 29 08:04:40 2022] DELETE /compute/v2.1/os-volumes/2d154e89-c57e-43b5-8d63-a6d60c2ee0b0 => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 29 08:04:40.974794 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-eeff4c20-5074-431b-b9cb-1a417939359a tempest-VolumesSnapshotsTestJSON-1495727199 tempest-VolumesSnapshotsTestJSON-1495727199-project] Calling method '.version_select at 0x7f72416d49d0>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:04:41.040702 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-52e21981-bbf6-443f-9c23-70c35d74fd9d tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4af4eedee24897be2e702ef51873b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab693125979f4bb7b7b3c94061610fe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:04:41.068489 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-52e21981-bbf6-443f-9c23-70c35d74fd9d tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] 10.222.0.43 "GET /compute/v2.1/servers/79765057-c430-4292-bc5f-ee0c6a66b367" status: 200 len: 1522 microversion: 2.1 time: 0.916993 Jun 29 08:04:41.073712 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-eeff4c20-5074-431b-b9cb-1a417939359a tempest-VolumesSnapshotsTestJSON-1495727199 tempest-VolumesSnapshotsTestJSON-1495727199-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/2d154e89-c57e-43b5-8d63-a6d60c2ee0b0" status: 200 len: 345 microversion: 2.1 time: 0.103982 Jun 29 08:04:41.075118 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 88/178] 10.222.0.43 () {58 vars in 1244 bytes} [Wed Jun 29 08:04:40 2022] GET /compute/v2.1/os-volumes/2d154e89-c57e-43b5-8d63-a6d60c2ee0b0 => generated 345 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:04:41.075563 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 91/179] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:04:40 2022] GET /compute/v2.1/servers/79765057-c430-4292-bc5f-ee0c6a66b367 => generated 1522 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:04:41.565383 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-fc07d972-3d2b-4e34-8f08-f1365e29bb2f tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:04:41.567978 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-fc07d972-3d2b-4e34-8f08-f1365e29bb2f tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] [instance: 2e99307a-e437-4e8d-821c-319cc555e209] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:04:41.580669 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-fc07d972-3d2b-4e34-8f08-f1365e29bb2f tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:04:41.581518 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-fc07d972-3d2b-4e34-8f08-f1365e29bb2f tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:04:41.584237 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-fc07d972-3d2b-4e34-8f08-f1365e29bb2f tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:04:41.585125 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-fc07d972-3d2b-4e34-8f08-f1365e29bb2f tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:04:41.864755 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-fc07d972-3d2b-4e34-8f08-f1365e29bb2f tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1feaba97f594ffda9dd2962bebdc082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdadf97d44048c3bec51c0ae58ee4a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:04:41.877554 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-fc07d972-3d2b-4e34-8f08-f1365e29bb2f tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] 10.222.0.43 "GET /compute/v2.1/servers/2e99307a-e437-4e8d-821c-319cc555e209" status: 200 len: 1318 microversion: 2.1 time: 0.320345 Jun 29 08:04:41.878158 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 89/180] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:04:41 2022] GET /compute/v2.1/servers/2e99307a-e437-4e8d-821c-319cc555e209 => generated 1318 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:04:42.131939 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-d9cad163-be48-4f80-96e9-bcef442a03c5 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:04:42.132914 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-5b995945-8808-40a6-be41-de1a5bb565f9 tempest-VolumesSnapshotsTestJSON-1495727199 tempest-VolumesSnapshotsTestJSON-1495727199-project] Calling method '.version_select at 0x7f7241702310>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:04:42.134974 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-d9cad163-be48-4f80-96e9-bcef442a03c5 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] [instance: 79765057-c430-4292-bc5f-ee0c6a66b367] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:04:42.182116 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-d9cad163-be48-4f80-96e9-bcef442a03c5 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:04:42.183836 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-d9cad163-be48-4f80-96e9-bcef442a03c5 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:04:42.184897 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-d9cad163-be48-4f80-96e9-bcef442a03c5 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:04:42.185893 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-d9cad163-be48-4f80-96e9-bcef442a03c5 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:04:42.234312 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.wsgi [None req-5b995945-8808-40a6-be41-de1a5bb565f9 tempest-VolumesSnapshotsTestJSON-1495727199 tempest-VolumesSnapshotsTestJSON-1495727199-project] HTTP exception thrown: Volume 2d154e89-c57e-43b5-8d63-a6d60c2ee0b0 could not be found. Jun 29 08:04:42.240145 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-5b995945-8808-40a6-be41-de1a5bb565f9 tempest-VolumesSnapshotsTestJSON-1495727199 tempest-VolumesSnapshotsTestJSON-1495727199-project] Request method failure captured: Jun 29 08:04:42.240145 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: request: GET /compute/v2.1/os-volumes/2d154e89-c57e-43b5-8d63-a6d60c2ee0b0 HTTP/1.1 Jun 29 08:04:42.240145 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: Accept: application/json Jun 29 08:04:42.240145 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: Accept-Encoding: identity Jun 29 08:04:42.240145 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: Connection: close Jun 29 08:04:42.240145 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: Content-Length: 0 Jun 29 08:04:42.240145 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: Content-Type: application/json Jun 29 08:04:42.240145 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: Host: 10.222.0.43 Jun 29 08:04:42.240145 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: Openstack-System-Scope: None Jun 29 08:04:42.240145 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: User-Agent: python-urllib3/1.26.9 Jun 29 08:04:42.240145 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Auth-Token: gAAAAABivAeQKNAKf13KU_Dxgnwz_Z-1-UiVlaY-41hVltVHpIvzK8j9aa6a-h0lwyOfaW9WDomPD-cVRx_g_r862lLBU36TcViO0LXT2FtnjznSsn7oZNuTjPr67hMwRX6RDaNBEaULWelStMtkuh1qvcpwAG6NB8-FLpCfKo3NxjOpW7cTdNw Jun 29 08:04:42.240145 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Domain-Id: None Jun 29 08:04:42.240145 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Domain-Name: None Jun 29 08:04:42.240145 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Identity-Status: Confirmed Jun 29 08:04:42.240145 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Is-Admin-Project: True Jun 29 08:04:42.240145 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Project-Domain-Id: default Jun 29 08:04:42.240145 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Project-Domain-Name: Default Jun 29 08:04:42.240145 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Project-Id: 69e2bbfe423846dc9755f233e89ecc8f Jun 29 08:04:42.240145 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1495727199 Jun 29 08:04:42.240145 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Role: member,reader Jun 29 08:04:42.240145 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Roles: member,reader Jun 29 08:04:42.241957 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/69e2bbfe423846dc9755f233e89ecc8f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_69e2bbfe423846dc9755f233e89ecc8f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/69e2bbfe423846dc9755f233e89ecc8f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/69e2bbfe423846dc9755f233e89ecc8f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Jun 29 08:04:42.241957 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1495727199 Jun 29 08:04:42.241957 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Tenant-Id: 69e2bbfe423846dc9755f233e89ecc8f Jun 29 08:04:42.241957 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1495727199 Jun 29 08:04:42.241957 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-User: tempest-VolumesSnapshotsTestJSON-1495727199-project Jun 29 08:04:42.241957 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-User-Domain-Id: default Jun 29 08:04:42.241957 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-User-Domain-Name: Default Jun 29 08:04:42.241957 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-User-Id: 719204a59b4c4344adb0d1b4c698003e Jun 29 08:04:42.241957 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1495727199-project Jun 29 08:04:42.241957 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: method: Jun 29 08:04:42.241957 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: exception: Volume 2d154e89-c57e-43b5-8d63-a6d60c2ee0b0 could not be found. Jun 29 08:04:42.241957 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: action_args: {'id': '2d154e89-c57e-43b5-8d63-a6d60c2ee0b0'} Jun 29 08:04:42.241957 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 08:04:42.242917 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:04:42.242917 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 29 08:04:42.242917 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 29 08:04:42.242917 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 29 08:04:42.242917 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 29 08:04:42.242917 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 29 08:04:42.242917 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 29 08:04:42.242917 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 29 08:04:42.242917 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 29 08:04:42.242917 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 29 08:04:42.242917 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 29 08:04:42.242917 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 29 08:04:42.242917 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 29 08:04:42.242917 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 29 08:04:42.242917 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 29 08:04:42.242917 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 2d154e89-c57e-43b5-8d63-a6d60c2ee0b0 could not be found. (HTTP 404) (Request-ID: req-147c47e2-34db-46fc-b88f-aaff7fa513ab) Jun 29 08:04:42.242917 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 29 08:04:42.242917 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 08:04:42.242917 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 29 08:04:42.244057 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:04:42.244057 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 29 08:04:42.244057 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 29 08:04:42.244057 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 29 08:04:42.244057 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 29 08:04:42.244057 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 29 08:04:42.244057 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 29 08:04:42.244057 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 29 08:04:42.244057 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 29 08:04:42.244057 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 29 08:04:42.244057 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 29 08:04:42.244057 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 29 08:04:42.244057 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 29 08:04:42.244057 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 29 08:04:42.244057 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 29 08:04:42.244057 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 29 08:04:42.244057 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 29 08:04:42.244057 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 29 08:04:42.244057 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 29 08:04:42.246394 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 29 08:04:42.246394 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 29 08:04:42.246394 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 29 08:04:42.246394 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 29 08:04:42.246394 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 2d154e89-c57e-43b5-8d63-a6d60c2ee0b0 could not be found. Jun 29 08:04:42.246394 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 29 08:04:42.246394 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 08:04:42.246394 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 29 08:04:42.246394 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:04:42.246394 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 08:04:42.246394 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 08:04:42.246394 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 08:04:42.246394 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 08:04:42.246394 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 29 08:04:42.246394 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 29 08:04:42.246394 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 08:04:42.246394 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 08:04:42.246394 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 29 08:04:42.246394 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 29 08:04:42.249323 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 2d154e89-c57e-43b5-8d63-a6d60c2ee0b0 could not be found. Jun 29 08:04:42.249323 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 29 08:04:42.249323 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 08:04:42.249323 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 29 08:04:42.249323 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:04:42.249323 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 08:04:42.249323 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 08:04:42.249323 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 08:04:42.249323 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 08:04:42.249323 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 2d154e89-c57e-43b5-8d63-a6d60c2ee0b0 could not be found. Jun 29 08:04:42.249323 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 29 08:04:42.249323 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-5b995945-8808-40a6-be41-de1a5bb565f9 tempest-VolumesSnapshotsTestJSON-1495727199 tempest-VolumesSnapshotsTestJSON-1495727199-project] Returning 404 to user: Volume 2d154e89-c57e-43b5-8d63-a6d60c2ee0b0 could not be found. {{(pid=117890) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 08:04:42.249323 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-5b995945-8808-40a6-be41-de1a5bb565f9 tempest-VolumesSnapshotsTestJSON-1495727199 tempest-VolumesSnapshotsTestJSON-1495727199-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/2d154e89-c57e-43b5-8d63-a6d60c2ee0b0" status: 404 len: 109 microversion: 2.1 time: 0.136942 Jun 29 08:04:42.257444 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 90/181] 10.222.0.43 () {58 vars in 1244 bytes} [Wed Jun 29 08:04:42 2022] GET /compute/v2.1/os-volumes/2d154e89-c57e-43b5-8d63-a6d60c2ee0b0 => generated 109 bytes in 153 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 29 08:04:42.310555 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-c00693be-5778-413e-a42c-1884d2bcc574 tempest-VolumesSnapshotsTestJSON-1495727199 tempest-VolumesSnapshotsTestJSON-1495727199-project] Calling method '.version_select at 0x7f724166be50>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:04:42.396542 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.wsgi [None req-c00693be-5778-413e-a42c-1884d2bcc574 tempest-VolumesSnapshotsTestJSON-1495727199 tempest-VolumesSnapshotsTestJSON-1495727199-project] HTTP exception thrown: Volume 2d154e89-c57e-43b5-8d63-a6d60c2ee0b0 could not be found. Jun 29 08:04:42.398558 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-c00693be-5778-413e-a42c-1884d2bcc574 tempest-VolumesSnapshotsTestJSON-1495727199 tempest-VolumesSnapshotsTestJSON-1495727199-project] Request method failure captured: Jun 29 08:04:42.398558 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: request: DELETE /compute/v2.1/os-volumes/2d154e89-c57e-43b5-8d63-a6d60c2ee0b0 HTTP/1.1 Jun 29 08:04:42.398558 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: Accept: application/json Jun 29 08:04:42.398558 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: Accept-Encoding: identity Jun 29 08:04:42.398558 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: Connection: close Jun 29 08:04:42.398558 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: Content-Length: 0 Jun 29 08:04:42.398558 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: Content-Type: application/json Jun 29 08:04:42.398558 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: Host: 10.222.0.43 Jun 29 08:04:42.398558 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: Openstack-System-Scope: None Jun 29 08:04:42.398558 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: User-Agent: python-urllib3/1.26.9 Jun 29 08:04:42.398558 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Auth-Token: gAAAAABivAeQKNAKf13KU_Dxgnwz_Z-1-UiVlaY-41hVltVHpIvzK8j9aa6a-h0lwyOfaW9WDomPD-cVRx_g_r862lLBU36TcViO0LXT2FtnjznSsn7oZNuTjPr67hMwRX6RDaNBEaULWelStMtkuh1qvcpwAG6NB8-FLpCfKo3NxjOpW7cTdNw Jun 29 08:04:42.398558 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Domain-Id: None Jun 29 08:04:42.398558 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Domain-Name: None Jun 29 08:04:42.398558 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Identity-Status: Confirmed Jun 29 08:04:42.398558 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Is-Admin-Project: True Jun 29 08:04:42.398558 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Project-Domain-Id: default Jun 29 08:04:42.398558 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Project-Domain-Name: Default Jun 29 08:04:42.398558 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Project-Id: 69e2bbfe423846dc9755f233e89ecc8f Jun 29 08:04:42.398558 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1495727199 Jun 29 08:04:42.398558 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Role: member,reader Jun 29 08:04:42.398558 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Roles: member,reader Jun 29 08:04:42.399866 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/69e2bbfe423846dc9755f233e89ecc8f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_69e2bbfe423846dc9755f233e89ecc8f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/69e2bbfe423846dc9755f233e89ecc8f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/69e2bbfe423846dc9755f233e89ecc8f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Jun 29 08:04:42.399866 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1495727199 Jun 29 08:04:42.399866 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Tenant-Id: 69e2bbfe423846dc9755f233e89ecc8f Jun 29 08:04:42.399866 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1495727199 Jun 29 08:04:42.399866 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-User: tempest-VolumesSnapshotsTestJSON-1495727199-project Jun 29 08:04:42.399866 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-User-Domain-Id: default Jun 29 08:04:42.399866 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-User-Domain-Name: Default Jun 29 08:04:42.399866 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-User-Id: 719204a59b4c4344adb0d1b4c698003e Jun 29 08:04:42.399866 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1495727199-project Jun 29 08:04:42.399866 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: method: Jun 29 08:04:42.399866 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: exception: Volume 2d154e89-c57e-43b5-8d63-a6d60c2ee0b0 could not be found. Jun 29 08:04:42.399866 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: action_args: {'id': '2d154e89-c57e-43b5-8d63-a6d60c2ee0b0'} Jun 29 08:04:42.399866 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 08:04:42.400871 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:04:42.400871 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 29 08:04:42.400871 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 29 08:04:42.400871 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 29 08:04:42.400871 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 29 08:04:42.400871 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 29 08:04:42.400871 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 29 08:04:42.400871 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 29 08:04:42.400871 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 29 08:04:42.400871 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 29 08:04:42.400871 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 29 08:04:42.400871 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 29 08:04:42.400871 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 29 08:04:42.400871 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 29 08:04:42.400871 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 29 08:04:42.400871 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 2d154e89-c57e-43b5-8d63-a6d60c2ee0b0 could not be found. (HTTP 404) (Request-ID: req-4b9f68e2-8291-4e3e-9872-c765811a9ef9) Jun 29 08:04:42.400871 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 29 08:04:42.400871 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 08:04:42.400871 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 29 08:04:42.402120 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:04:42.402120 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 29 08:04:42.402120 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 29 08:04:42.402120 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 29 08:04:42.402120 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 29 08:04:42.402120 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 29 08:04:42.402120 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 29 08:04:42.402120 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 29 08:04:42.402120 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 29 08:04:42.402120 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 29 08:04:42.402120 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 29 08:04:42.402120 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 29 08:04:42.402120 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 29 08:04:42.402120 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 29 08:04:42.402120 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 29 08:04:42.402120 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 29 08:04:42.402120 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 29 08:04:42.402120 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 29 08:04:42.402120 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 29 08:04:42.403275 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 29 08:04:42.403275 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 29 08:04:42.403275 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 29 08:04:42.403275 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 29 08:04:42.403275 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 2d154e89-c57e-43b5-8d63-a6d60c2ee0b0 could not be found. Jun 29 08:04:42.403275 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 29 08:04:42.403275 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 08:04:42.403275 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 29 08:04:42.403275 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:04:42.403275 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 08:04:42.403275 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 08:04:42.403275 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 08:04:42.403275 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 08:04:42.403275 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 29 08:04:42.403275 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 29 08:04:42.403275 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 08:04:42.403275 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 08:04:42.403275 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 29 08:04:42.403275 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 29 08:04:42.404471 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 2d154e89-c57e-43b5-8d63-a6d60c2ee0b0 could not be found. Jun 29 08:04:42.404471 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 29 08:04:42.404471 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 08:04:42.404471 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 29 08:04:42.404471 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:04:42.404471 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 08:04:42.404471 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 08:04:42.404471 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 08:04:42.404471 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 08:04:42.404471 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 2d154e89-c57e-43b5-8d63-a6d60c2ee0b0 could not be found. Jun 29 08:04:42.404471 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 29 08:04:42.404471 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-c00693be-5778-413e-a42c-1884d2bcc574 tempest-VolumesSnapshotsTestJSON-1495727199 tempest-VolumesSnapshotsTestJSON-1495727199-project] Returning 404 to user: Volume 2d154e89-c57e-43b5-8d63-a6d60c2ee0b0 could not be found. {{(pid=117890) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 08:04:42.404471 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-c00693be-5778-413e-a42c-1884d2bcc574 tempest-VolumesSnapshotsTestJSON-1495727199 tempest-VolumesSnapshotsTestJSON-1495727199-project] 10.222.0.43 "DELETE /compute/v2.1/os-volumes/2d154e89-c57e-43b5-8d63-a6d60c2ee0b0" status: 404 len: 109 microversion: 2.1 time: 0.135737 Jun 29 08:04:42.404471 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 91/182] 10.222.0.43 () {58 vars in 1247 bytes} [Wed Jun 29 08:04:42 2022] DELETE /compute/v2.1/os-volumes/2d154e89-c57e-43b5-8d63-a6d60c2ee0b0 => generated 109 bytes in 137 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 29 08:04:42.411843 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-924bb544-2ca1-45e4-889a-f5b5d45cd013 tempest-VolumesSnapshotsTestJSON-1495727199 tempest-VolumesSnapshotsTestJSON-1495727199-project] Calling method '.version_select at 0x7f72416d45e0>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:04:42.475151 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.wsgi [None req-924bb544-2ca1-45e4-889a-f5b5d45cd013 tempest-VolumesSnapshotsTestJSON-1495727199 tempest-VolumesSnapshotsTestJSON-1495727199-project] HTTP exception thrown: Volume 2d154e89-c57e-43b5-8d63-a6d60c2ee0b0 could not be found. Jun 29 08:04:42.477638 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-924bb544-2ca1-45e4-889a-f5b5d45cd013 tempest-VolumesSnapshotsTestJSON-1495727199 tempest-VolumesSnapshotsTestJSON-1495727199-project] Request method failure captured: Jun 29 08:04:42.477638 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: request: GET /compute/v2.1/os-volumes/2d154e89-c57e-43b5-8d63-a6d60c2ee0b0 HTTP/1.1 Jun 29 08:04:42.477638 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: Accept: application/json Jun 29 08:04:42.477638 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: Accept-Encoding: identity Jun 29 08:04:42.477638 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: Connection: close Jun 29 08:04:42.477638 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: Content-Length: 0 Jun 29 08:04:42.477638 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: Content-Type: application/json Jun 29 08:04:42.477638 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: Host: 10.222.0.43 Jun 29 08:04:42.477638 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: Openstack-System-Scope: None Jun 29 08:04:42.477638 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: User-Agent: python-urllib3/1.26.9 Jun 29 08:04:42.477638 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Auth-Token: gAAAAABivAeQKNAKf13KU_Dxgnwz_Z-1-UiVlaY-41hVltVHpIvzK8j9aa6a-h0lwyOfaW9WDomPD-cVRx_g_r862lLBU36TcViO0LXT2FtnjznSsn7oZNuTjPr67hMwRX6RDaNBEaULWelStMtkuh1qvcpwAG6NB8-FLpCfKo3NxjOpW7cTdNw Jun 29 08:04:42.477638 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Domain-Id: None Jun 29 08:04:42.477638 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Domain-Name: None Jun 29 08:04:42.477638 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Identity-Status: Confirmed Jun 29 08:04:42.477638 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Is-Admin-Project: True Jun 29 08:04:42.477638 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Project-Domain-Id: default Jun 29 08:04:42.477638 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Project-Domain-Name: Default Jun 29 08:04:42.477638 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Project-Id: 69e2bbfe423846dc9755f233e89ecc8f Jun 29 08:04:42.477638 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1495727199 Jun 29 08:04:42.477638 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Role: member,reader Jun 29 08:04:42.477638 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Roles: member,reader Jun 29 08:04:42.478985 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/69e2bbfe423846dc9755f233e89ecc8f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_69e2bbfe423846dc9755f233e89ecc8f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/69e2bbfe423846dc9755f233e89ecc8f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/69e2bbfe423846dc9755f233e89ecc8f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Jun 29 08:04:42.478985 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1495727199 Jun 29 08:04:42.478985 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Tenant-Id: 69e2bbfe423846dc9755f233e89ecc8f Jun 29 08:04:42.478985 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1495727199 Jun 29 08:04:42.478985 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-User: tempest-VolumesSnapshotsTestJSON-1495727199-project Jun 29 08:04:42.478985 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-User-Domain-Id: default Jun 29 08:04:42.478985 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-User-Domain-Name: Default Jun 29 08:04:42.478985 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-User-Id: 719204a59b4c4344adb0d1b4c698003e Jun 29 08:04:42.478985 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1495727199-project Jun 29 08:04:42.478985 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: method: Jun 29 08:04:42.478985 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: exception: Volume 2d154e89-c57e-43b5-8d63-a6d60c2ee0b0 could not be found. Jun 29 08:04:42.478985 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: action_args: {'id': '2d154e89-c57e-43b5-8d63-a6d60c2ee0b0'} Jun 29 08:04:42.478985 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 08:04:42.479786 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:04:42.479786 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 29 08:04:42.479786 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 29 08:04:42.479786 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 29 08:04:42.479786 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 29 08:04:42.479786 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 29 08:04:42.479786 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 29 08:04:42.479786 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 29 08:04:42.479786 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 29 08:04:42.479786 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 29 08:04:42.479786 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 29 08:04:42.479786 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 29 08:04:42.479786 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 29 08:04:42.479786 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 29 08:04:42.479786 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 29 08:04:42.479786 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 2d154e89-c57e-43b5-8d63-a6d60c2ee0b0 could not be found. (HTTP 404) (Request-ID: req-023e70bd-6954-4522-8826-85eaa1c40bac) Jun 29 08:04:42.479786 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 29 08:04:42.479786 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 08:04:42.479786 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 29 08:04:42.481059 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:04:42.481059 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 29 08:04:42.481059 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 29 08:04:42.481059 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 29 08:04:42.481059 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 29 08:04:42.481059 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 29 08:04:42.481059 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 29 08:04:42.481059 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 29 08:04:42.481059 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 29 08:04:42.481059 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 29 08:04:42.481059 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 29 08:04:42.481059 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 29 08:04:42.481059 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 29 08:04:42.481059 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 29 08:04:42.481059 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 29 08:04:42.481059 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 29 08:04:42.481059 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 29 08:04:42.481059 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 29 08:04:42.481059 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 29 08:04:42.482182 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 29 08:04:42.482182 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 29 08:04:42.482182 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 29 08:04:42.482182 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 29 08:04:42.482182 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 2d154e89-c57e-43b5-8d63-a6d60c2ee0b0 could not be found. Jun 29 08:04:42.482182 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 29 08:04:42.482182 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 08:04:42.482182 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 29 08:04:42.482182 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:04:42.482182 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 08:04:42.482182 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 08:04:42.482182 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 08:04:42.482182 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 08:04:42.482182 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 29 08:04:42.482182 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 29 08:04:42.482182 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 08:04:42.482182 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 08:04:42.482182 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 29 08:04:42.482182 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 29 08:04:42.483269 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 2d154e89-c57e-43b5-8d63-a6d60c2ee0b0 could not be found. Jun 29 08:04:42.483269 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 29 08:04:42.483269 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 08:04:42.483269 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 29 08:04:42.483269 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:04:42.483269 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 08:04:42.483269 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 08:04:42.483269 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 08:04:42.483269 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 08:04:42.483269 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 2d154e89-c57e-43b5-8d63-a6d60c2ee0b0 could not be found. Jun 29 08:04:42.483269 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 29 08:04:42.483269 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-924bb544-2ca1-45e4-889a-f5b5d45cd013 tempest-VolumesSnapshotsTestJSON-1495727199 tempest-VolumesSnapshotsTestJSON-1495727199-project] Returning 404 to user: Volume 2d154e89-c57e-43b5-8d63-a6d60c2ee0b0 could not be found. {{(pid=117890) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 08:04:42.483269 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-924bb544-2ca1-45e4-889a-f5b5d45cd013 tempest-VolumesSnapshotsTestJSON-1495727199 tempest-VolumesSnapshotsTestJSON-1495727199-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/2d154e89-c57e-43b5-8d63-a6d60c2ee0b0" status: 404 len: 109 microversion: 2.1 time: 0.072464 Jun 29 08:04:42.483269 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 92/183] 10.222.0.43 () {58 vars in 1244 bytes} [Wed Jun 29 08:04:42 2022] GET /compute/v2.1/os-volumes/2d154e89-c57e-43b5-8d63-a6d60c2ee0b0 => generated 109 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 29 08:04:42.909666 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-c773cc1b-1b8d-4d3d-a09e-f62fb15bdf35 tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:04:42.910346 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-c773cc1b-1b8d-4d3d-a09e-f62fb15bdf35 tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] [instance: 2e99307a-e437-4e8d-821c-319cc555e209] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:04:42.924708 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-c773cc1b-1b8d-4d3d-a09e-f62fb15bdf35 tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:04:42.926886 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-c773cc1b-1b8d-4d3d-a09e-f62fb15bdf35 tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:04:42.931411 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-c773cc1b-1b8d-4d3d-a09e-f62fb15bdf35 tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:04:42.934174 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-c773cc1b-1b8d-4d3d-a09e-f62fb15bdf35 tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:04:43.186906 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-c773cc1b-1b8d-4d3d-a09e-f62fb15bdf35 tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1feaba97f594ffda9dd2962bebdc082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdadf97d44048c3bec51c0ae58ee4a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:04:43.199680 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-c773cc1b-1b8d-4d3d-a09e-f62fb15bdf35 tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] 10.222.0.43 "GET /compute/v2.1/servers/2e99307a-e437-4e8d-821c-319cc555e209" status: 200 len: 1318 microversion: 2.1 time: 0.296654 Jun 29 08:04:43.209608 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 93/184] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:04:42 2022] GET /compute/v2.1/servers/2e99307a-e437-4e8d-821c-319cc555e209 => generated 1318 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 08:04:43.412299 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-d9cad163-be48-4f80-96e9-bcef442a03c5 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4af4eedee24897be2e702ef51873b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab693125979f4bb7b7b3c94061610fe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:04:43.423227 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-d9cad163-be48-4f80-96e9-bcef442a03c5 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] 10.222.0.43 "GET /compute/v2.1/servers/79765057-c430-4292-bc5f-ee0c6a66b367" status: 200 len: 1522 microversion: 2.1 time: 1.320323 Jun 29 08:04:43.428925 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 92/185] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:04:42 2022] GET /compute/v2.1/servers/79765057-c430-4292-bc5f-ee0c6a66b367 => generated 1522 bytes in 1328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:04:44.218778 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-ae8aa7a3-2267-475c-83ac-570b9184e1c1 tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:04:44.220907 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-ae8aa7a3-2267-475c-83ac-570b9184e1c1 tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] [instance: 2e99307a-e437-4e8d-821c-319cc555e209] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:04:44.244908 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-ae8aa7a3-2267-475c-83ac-570b9184e1c1 tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:04:44.247652 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-ae8aa7a3-2267-475c-83ac-570b9184e1c1 tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:04:44.253908 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-ae8aa7a3-2267-475c-83ac-570b9184e1c1 tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:04:44.257063 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-ae8aa7a3-2267-475c-83ac-570b9184e1c1 tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:04:44.429879 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [req-bba661fb-5126-4432-a1f6-aebacfac69f9 req-1cbf5058-dc89-4c6d-8b41-61f554a8d125 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2e99307a-e437-4e8d-821c-319cc555e209", "tag": "dec20ad0-8f1a-494a-ad93-6642576929a5"}]} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:04:44.451480 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-bba661fb-5126-4432-a1f6-aebacfac69f9 req-1cbf5058-dc89-4c6d-8b41-61f554a8d125 service nova] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:04:44.452469 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-bba661fb-5126-4432-a1f6-aebacfac69f9 req-1cbf5058-dc89-4c6d-8b41-61f554a8d125 service nova] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:04:44.515563 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.compute.server_external_events [req-bba661fb-5126-4432-a1f6-aebacfac69f9 req-1cbf5058-dc89-4c6d-8b41-61f554a8d125 service nova] Creating event network-changed:dec20ad0-8f1a-494a-ad93-6642576929a5 for instance 2e99307a-e437-4e8d-821c-319cc555e209 on hv-cinder-76810 Jun 29 08:04:44.537261 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [req-bba661fb-5126-4432-a1f6-aebacfac69f9 req-1cbf5058-dc89-4c6d-8b41-61f554a8d125 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.115649 Jun 29 08:04:44.538533 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 93/186] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jun 29 08:04:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 29 08:04:44.564022 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-0d7e0008-d363-4f98-a214-f66c965b533a tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:04:44.574232 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-0d7e0008-d363-4f98-a214-f66c965b533a tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] [instance: 79765057-c430-4292-bc5f-ee0c6a66b367] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:04:44.578893 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-ae8aa7a3-2267-475c-83ac-570b9184e1c1 tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1feaba97f594ffda9dd2962bebdc082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdadf97d44048c3bec51c0ae58ee4a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:04:44.594306 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-ae8aa7a3-2267-475c-83ac-570b9184e1c1 tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] 10.222.0.43 "GET /compute/v2.1/servers/2e99307a-e437-4e8d-821c-319cc555e209" status: 200 len: 1318 microversion: 2.1 time: 0.380811 Jun 29 08:04:44.595772 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 94/187] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:04:44 2022] GET /compute/v2.1/servers/2e99307a-e437-4e8d-821c-319cc555e209 => generated 1318 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:04:44.606426 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-0d7e0008-d363-4f98-a214-f66c965b533a tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:04:44.609653 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-0d7e0008-d363-4f98-a214-f66c965b533a tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:04:44.613055 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-0d7e0008-d363-4f98-a214-f66c965b533a tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:04:44.614467 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-0d7e0008-d363-4f98-a214-f66c965b533a tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:04:44.643878 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:04:44.902599 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-0d7e0008-d363-4f98-a214-f66c965b533a tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4af4eedee24897be2e702ef51873b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab693125979f4bb7b7b3c94061610fe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:04:44.923177 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-0d7e0008-d363-4f98-a214-f66c965b533a tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] 10.222.0.43 "GET /compute/v2.1/servers/79765057-c430-4292-bc5f-ee0c6a66b367" status: 200 len: 1522 microversion: 2.1 time: 0.381968 Jun 29 08:04:44.924651 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 94/188] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:04:44 2022] GET /compute/v2.1/servers/79765057-c430-4292-bc5f-ee0c6a66b367 => generated 1522 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:04:45.633998 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-12596441-7b68-4afe-b066-49f4c3ece4e0 tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:04:45.647768 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-12596441-7b68-4afe-b066-49f4c3ece4e0 tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] [instance: 2e99307a-e437-4e8d-821c-319cc555e209] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:04:45.667656 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-12596441-7b68-4afe-b066-49f4c3ece4e0 tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:04:45.668442 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-12596441-7b68-4afe-b066-49f4c3ece4e0 tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:04:45.670001 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-12596441-7b68-4afe-b066-49f4c3ece4e0 tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:04:45.670776 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-12596441-7b68-4afe-b066-49f4c3ece4e0 tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:04:45.841901 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_cell0:SELECT=2 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:04:45.843592 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_cell0:SELECT=8 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:04:46.121952 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-12596441-7b68-4afe-b066-49f4c3ece4e0 tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1feaba97f594ffda9dd2962bebdc082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdadf97d44048c3bec51c0ae58ee4a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:04:46.141707 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-12596441-7b68-4afe-b066-49f4c3ece4e0 tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] 10.222.0.43 "GET /compute/v2.1/servers/2e99307a-e437-4e8d-821c-319cc555e209" status: 200 len: 1318 microversion: 2.1 time: 0.516380 Jun 29 08:04:46.142712 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 95/189] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:04:45 2022] GET /compute/v2.1/servers/2e99307a-e437-4e8d-821c-319cc555e209 => generated 1318 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:04:46.163077 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-af2b4987-fbb4-4035-97d8-9b37d32a3c73 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:04:46.175226 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-4b38e045-8aeb-4448-9ef2-461ace862660 tempest-VolumesGetTestJSON-1173458071 tempest-VolumesGetTestJSON-1173458071-project] Action: 'create', calling method: .version_select at 0x7f7241598310>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1697939411", "metadata": {"Type": "work"}}} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:04:46.177574 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-af2b4987-fbb4-4035-97d8-9b37d32a3c73 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] [instance: 79765057-c430-4292-bc5f-ee0c6a66b367] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:04:46.196808 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-af2b4987-fbb4-4035-97d8-9b37d32a3c73 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:04:46.198624 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-af2b4987-fbb4-4035-97d8-9b37d32a3c73 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:04:46.199739 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-af2b4987-fbb4-4035-97d8-9b37d32a3c73 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:04:46.201570 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-af2b4987-fbb4-4035-97d8-9b37d32a3c73 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:04:46.510132 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-af2b4987-fbb4-4035-97d8-9b37d32a3c73 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4af4eedee24897be2e702ef51873b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab693125979f4bb7b7b3c94061610fe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:04:46.514000 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG dbcounter [-] [117890] Writing DB stats nova_cell1:SELECT=100 {{(pid=117890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:04:46.545473 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-af2b4987-fbb4-4035-97d8-9b37d32a3c73 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] 10.222.0.43 "GET /compute/v2.1/servers/79765057-c430-4292-bc5f-ee0c6a66b367" status: 200 len: 1522 microversion: 2.1 time: 0.397972 Jun 29 08:04:46.547178 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 96/190] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:04:46 2022] GET /compute/v2.1/servers/79765057-c430-4292-bc5f-ee0c6a66b367 => generated 1522 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:04:47.076858 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-4b38e045-8aeb-4448-9ef2-461ace862660 tempest-VolumesGetTestJSON-1173458071 tempest-VolumesGetTestJSON-1173458071-project] 10.222.0.43 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 1.240427 Jun 29 08:04:47.078997 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 95/191] 10.222.0.43 () {60 vars in 1155 bytes} [Wed Jun 29 08:04:45 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 1244 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jun 29 08:04:47.099837 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-9c0fb452-5ec4-4f6c-a445-614b9918983f tempest-VolumesGetTestJSON-1173458071 tempest-VolumesGetTestJSON-1173458071-project] Calling method '.version_select at 0x7f724166b310>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:04:47.169613 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-07823ba5-a1c0-4f37-b08d-b9bce8eca248 tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:04:47.171642 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-07823ba5-a1c0-4f37-b08d-b9bce8eca248 tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] [instance: 2e99307a-e437-4e8d-821c-319cc555e209] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:04:47.225776 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-07823ba5-a1c0-4f37-b08d-b9bce8eca248 tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:04:47.228234 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-07823ba5-a1c0-4f37-b08d-b9bce8eca248 tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:04:47.241269 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-07823ba5-a1c0-4f37-b08d-b9bce8eca248 tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:04:47.242739 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-07823ba5-a1c0-4f37-b08d-b9bce8eca248 tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:04:47.290243 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-9c0fb452-5ec4-4f6c-a445-614b9918983f tempest-VolumesGetTestJSON-1173458071 tempest-VolumesGetTestJSON-1173458071-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/5f4ae39b-5298-4fd2-bfe2-94276ba4a1bc" status: 200 len: 353 microversion: 2.1 time: 0.197827 Jun 29 08:04:47.291715 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 97/192] 10.222.0.43 () {58 vars in 1244 bytes} [Wed Jun 29 08:04:47 2022] GET /compute/v2.1/os-volumes/5f4ae39b-5298-4fd2-bfe2-94276ba4a1bc => generated 353 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:04:47.584703 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-596f4a83-5870-46ef-b01c-29e2c7528942 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:04:47.589570 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-596f4a83-5870-46ef-b01c-29e2c7528942 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] [instance: 79765057-c430-4292-bc5f-ee0c6a66b367] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:04:47.605942 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-596f4a83-5870-46ef-b01c-29e2c7528942 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:04:47.607215 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-596f4a83-5870-46ef-b01c-29e2c7528942 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:04:47.609011 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-596f4a83-5870-46ef-b01c-29e2c7528942 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:04:47.610148 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-596f4a83-5870-46ef-b01c-29e2c7528942 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:04:47.843710 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-07823ba5-a1c0-4f37-b08d-b9bce8eca248 tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1feaba97f594ffda9dd2962bebdc082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdadf97d44048c3bec51c0ae58ee4a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:04:47.859190 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-07823ba5-a1c0-4f37-b08d-b9bce8eca248 tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] 10.222.0.43 "GET /compute/v2.1/servers/2e99307a-e437-4e8d-821c-319cc555e209" status: 200 len: 1318 microversion: 2.1 time: 0.698481 Jun 29 08:04:47.876937 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 96/193] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:04:47 2022] GET /compute/v2.1/servers/2e99307a-e437-4e8d-821c-319cc555e209 => generated 1318 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:04:48.312248 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-963c7beb-7fd7-408c-9d88-6e48e9f2def0 tempest-VolumesGetTestJSON-1173458071 tempest-VolumesGetTestJSON-1173458071-project] Calling method '.version_select at 0x7f7241598ee0>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:04:48.529213 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-963c7beb-7fd7-408c-9d88-6e48e9f2def0 tempest-VolumesGetTestJSON-1173458071 tempest-VolumesGetTestJSON-1173458071-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/5f4ae39b-5298-4fd2-bfe2-94276ba4a1bc" status: 200 len: 354 microversion: 2.1 time: 0.224681 Jun 29 08:04:48.530028 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 97/194] 10.222.0.43 () {58 vars in 1244 bytes} [Wed Jun 29 08:04:48 2022] GET /compute/v2.1/os-volumes/5f4ae39b-5298-4fd2-bfe2-94276ba4a1bc => generated 354 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:04:48.545597 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-381a1a0f-72f2-4667-b2a9-497c4015d08c tempest-VolumesGetTestJSON-1173458071 tempest-VolumesGetTestJSON-1173458071-project] Calling method '.version_select at 0x7f7241581d30>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:04:48.613031 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-596f4a83-5870-46ef-b01c-29e2c7528942 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4af4eedee24897be2e702ef51873b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab693125979f4bb7b7b3c94061610fe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:04:48.661780 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-596f4a83-5870-46ef-b01c-29e2c7528942 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] 10.222.0.43 "GET /compute/v2.1/servers/79765057-c430-4292-bc5f-ee0c6a66b367" status: 200 len: 1522 microversion: 2.1 time: 1.084511 Jun 29 08:04:48.667917 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 98/195] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:04:47 2022] GET /compute/v2.1/servers/79765057-c430-4292-bc5f-ee0c6a66b367 => generated 1522 bytes in 1094 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 08:04:48.779565 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-381a1a0f-72f2-4667-b2a9-497c4015d08c tempest-VolumesGetTestJSON-1173458071 tempest-VolumesGetTestJSON-1173458071-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/5f4ae39b-5298-4fd2-bfe2-94276ba4a1bc" status: 200 len: 354 microversion: 2.1 time: 0.241452 Jun 29 08:04:48.780574 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 98/196] 10.222.0.43 () {58 vars in 1244 bytes} [Wed Jun 29 08:04:48 2022] GET /compute/v2.1/os-volumes/5f4ae39b-5298-4fd2-bfe2-94276ba4a1bc => generated 354 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:04:48.802641 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-0dc50b08-661e-457a-a7ef-2888a82ec83e tempest-VolumesGetTestJSON-1173458071 tempest-VolumesGetTestJSON-1173458071-project] Calling method '.version_select at 0x7f724168faf0>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:04:48.885502 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-e0cad55b-71cc-4a10-bbb4-0b5b0a421d0b tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:04:48.886652 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-e0cad55b-71cc-4a10-bbb4-0b5b0a421d0b tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] [instance: 2e99307a-e437-4e8d-821c-319cc555e209] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:04:48.906617 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e0cad55b-71cc-4a10-bbb4-0b5b0a421d0b tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:04:48.914683 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e0cad55b-71cc-4a10-bbb4-0b5b0a421d0b tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:04:48.915818 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e0cad55b-71cc-4a10-bbb4-0b5b0a421d0b tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:04:48.916365 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e0cad55b-71cc-4a10-bbb4-0b5b0a421d0b tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:04:49.030824 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-0dc50b08-661e-457a-a7ef-2888a82ec83e tempest-VolumesGetTestJSON-1173458071 tempest-VolumesGetTestJSON-1173458071-project] 10.222.0.43 "DELETE /compute/v2.1/os-volumes/5f4ae39b-5298-4fd2-bfe2-94276ba4a1bc" status: 202 len: 0 microversion: 2.1 time: 0.235968 Jun 29 08:04:49.031927 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 99/197] 10.222.0.43 () {58 vars in 1247 bytes} [Wed Jun 29 08:04:48 2022] DELETE /compute/v2.1/os-volumes/5f4ae39b-5298-4fd2-bfe2-94276ba4a1bc => generated 0 bytes in 239 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 29 08:04:49.061703 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-9aedf05e-a598-4091-9e1c-8bc222092b2c tempest-VolumesGetTestJSON-1173458071 tempest-VolumesGetTestJSON-1173458071-project] Calling method '.version_select at 0x7f724166bd30>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:04:49.140053 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-9aedf05e-a598-4091-9e1c-8bc222092b2c tempest-VolumesGetTestJSON-1173458071 tempest-VolumesGetTestJSON-1173458071-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/5f4ae39b-5298-4fd2-bfe2-94276ba4a1bc" status: 200 len: 353 microversion: 2.1 time: 0.102811 Jun 29 08:04:49.141540 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 100/198] 10.222.0.43 () {58 vars in 1244 bytes} [Wed Jun 29 08:04:49 2022] GET /compute/v2.1/os-volumes/5f4ae39b-5298-4fd2-bfe2-94276ba4a1bc => generated 353 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 29 08:04:49.413527 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-e0cad55b-71cc-4a10-bbb4-0b5b0a421d0b tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1feaba97f594ffda9dd2962bebdc082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdadf97d44048c3bec51c0ae58ee4a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:04:49.460958 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-e0cad55b-71cc-4a10-bbb4-0b5b0a421d0b tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] 10.222.0.43 "GET /compute/v2.1/servers/2e99307a-e437-4e8d-821c-319cc555e209" status: 200 len: 1318 microversion: 2.1 time: 0.573660 Jun 29 08:04:49.484425 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 99/199] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:04:48 2022] GET /compute/v2.1/servers/2e99307a-e437-4e8d-821c-319cc555e209 => generated 1318 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:04:49.692782 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-301d25fb-6167-4151-8c7c-2e68287c02d3 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:04:49.695720 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-301d25fb-6167-4151-8c7c-2e68287c02d3 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] [instance: 79765057-c430-4292-bc5f-ee0c6a66b367] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:04:49.715550 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-301d25fb-6167-4151-8c7c-2e68287c02d3 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:04:49.717552 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-301d25fb-6167-4151-8c7c-2e68287c02d3 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:04:49.720290 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-301d25fb-6167-4151-8c7c-2e68287c02d3 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:04:49.722029 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-301d25fb-6167-4151-8c7c-2e68287c02d3 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:04:50.143980 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-301d25fb-6167-4151-8c7c-2e68287c02d3 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4af4eedee24897be2e702ef51873b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab693125979f4bb7b7b3c94061610fe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:04:50.157749 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-9b8d93ed-2494-480e-87c7-c2a7a43f028d tempest-VolumesGetTestJSON-1173458071 tempest-VolumesGetTestJSON-1173458071-project] Calling method '.version_select at 0x7f7241598dc0>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:04:50.160435 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-301d25fb-6167-4151-8c7c-2e68287c02d3 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] 10.222.0.43 "GET /compute/v2.1/servers/79765057-c430-4292-bc5f-ee0c6a66b367" status: 200 len: 1522 microversion: 2.1 time: 0.478151 Jun 29 08:04:50.162627 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 101/200] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:04:49 2022] GET /compute/v2.1/servers/79765057-c430-4292-bc5f-ee0c6a66b367 => generated 1522 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:04:50.219710 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.wsgi [None req-9b8d93ed-2494-480e-87c7-c2a7a43f028d tempest-VolumesGetTestJSON-1173458071 tempest-VolumesGetTestJSON-1173458071-project] HTTP exception thrown: Volume 5f4ae39b-5298-4fd2-bfe2-94276ba4a1bc could not be found. Jun 29 08:04:50.229440 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-9b8d93ed-2494-480e-87c7-c2a7a43f028d tempest-VolumesGetTestJSON-1173458071 tempest-VolumesGetTestJSON-1173458071-project] Request method failure captured: Jun 29 08:04:50.229440 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: request: GET /compute/v2.1/os-volumes/5f4ae39b-5298-4fd2-bfe2-94276ba4a1bc HTTP/1.1 Jun 29 08:04:50.229440 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: Accept: application/json Jun 29 08:04:50.229440 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: Accept-Encoding: identity Jun 29 08:04:50.229440 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: Connection: close Jun 29 08:04:50.229440 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: Content-Length: 0 Jun 29 08:04:50.229440 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: Content-Type: application/json Jun 29 08:04:50.229440 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: Host: 10.222.0.43 Jun 29 08:04:50.229440 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: Openstack-System-Scope: None Jun 29 08:04:50.229440 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: User-Agent: python-urllib3/1.26.9 Jun 29 08:04:50.229440 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Auth-Token: gAAAAABivAedN3BPwsn-wwyGKQ9IJlYNUPPKH7qF4NDrJHKERkWor5ROfcWOCCl4bDzQ1hR0aBx9DLF9moZjvlGJ_UInid28p0SvN1S6sAljcf97U3QGzr8UCv9MJixmFoVo_hsSsRAYYEyvJ2EM2n5YKbMK_aub6lmzNLFVlg_fNADGzWSF5lI Jun 29 08:04:50.229440 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Domain-Id: None Jun 29 08:04:50.229440 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Domain-Name: None Jun 29 08:04:50.229440 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Identity-Status: Confirmed Jun 29 08:04:50.229440 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Is-Admin-Project: True Jun 29 08:04:50.229440 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Project-Domain-Id: default Jun 29 08:04:50.229440 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Project-Domain-Name: Default Jun 29 08:04:50.229440 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Project-Id: d8864e0889984983bbe1ace5f6f51705 Jun 29 08:04:50.229440 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Project-Name: tempest-VolumesGetTestJSON-1173458071 Jun 29 08:04:50.229440 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Role: member,reader Jun 29 08:04:50.229440 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Roles: member,reader Jun 29 08:04:50.232161 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d8864e0889984983bbe1ace5f6f51705"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_d8864e0889984983bbe1ace5f6f51705"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d8864e0889984983bbe1ace5f6f51705"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/d8864e0889984983bbe1ace5f6f51705"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Jun 29 08:04:50.232161 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Tenant: tempest-VolumesGetTestJSON-1173458071 Jun 29 08:04:50.232161 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Tenant-Id: d8864e0889984983bbe1ace5f6f51705 Jun 29 08:04:50.232161 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Tenant-Name: tempest-VolumesGetTestJSON-1173458071 Jun 29 08:04:50.232161 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-User: tempest-VolumesGetTestJSON-1173458071-project Jun 29 08:04:50.232161 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-User-Domain-Id: default Jun 29 08:04:50.232161 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-User-Domain-Name: Default Jun 29 08:04:50.232161 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-User-Id: f19181a282a742a98f1781e61b3bce8d Jun 29 08:04:50.232161 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-User-Name: tempest-VolumesGetTestJSON-1173458071-project Jun 29 08:04:50.232161 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: method: Jun 29 08:04:50.232161 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: exception: Volume 5f4ae39b-5298-4fd2-bfe2-94276ba4a1bc could not be found. Jun 29 08:04:50.232161 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: action_args: {'id': '5f4ae39b-5298-4fd2-bfe2-94276ba4a1bc'} Jun 29 08:04:50.232161 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 08:04:50.234115 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:04:50.234115 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 29 08:04:50.234115 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 29 08:04:50.234115 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 29 08:04:50.234115 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 29 08:04:50.234115 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 29 08:04:50.234115 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 29 08:04:50.234115 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 29 08:04:50.234115 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 29 08:04:50.234115 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 29 08:04:50.234115 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 29 08:04:50.234115 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 29 08:04:50.234115 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 29 08:04:50.234115 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 29 08:04:50.234115 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 29 08:04:50.234115 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 5f4ae39b-5298-4fd2-bfe2-94276ba4a1bc could not be found. (HTTP 404) (Request-ID: req-c05e086c-91aa-489c-a792-d44beac27b94) Jun 29 08:04:50.234115 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 29 08:04:50.234115 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 08:04:50.234115 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 29 08:04:50.237696 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:04:50.237696 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 29 08:04:50.237696 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 29 08:04:50.237696 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 29 08:04:50.237696 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 29 08:04:50.237696 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 29 08:04:50.237696 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 29 08:04:50.237696 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 29 08:04:50.237696 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 29 08:04:50.237696 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 29 08:04:50.237696 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 29 08:04:50.237696 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 29 08:04:50.237696 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 29 08:04:50.237696 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 29 08:04:50.237696 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 29 08:04:50.237696 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 29 08:04:50.237696 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 29 08:04:50.237696 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 29 08:04:50.237696 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 29 08:04:50.246664 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 29 08:04:50.246664 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 29 08:04:50.246664 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 29 08:04:50.246664 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 29 08:04:50.246664 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 5f4ae39b-5298-4fd2-bfe2-94276ba4a1bc could not be found. Jun 29 08:04:50.246664 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 29 08:04:50.246664 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 08:04:50.246664 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 29 08:04:50.246664 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:04:50.246664 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 08:04:50.246664 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 08:04:50.246664 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 08:04:50.246664 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 08:04:50.246664 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 29 08:04:50.246664 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 29 08:04:50.246664 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 08:04:50.246664 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 08:04:50.246664 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 29 08:04:50.246664 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 29 08:04:50.248852 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 5f4ae39b-5298-4fd2-bfe2-94276ba4a1bc could not be found. Jun 29 08:04:50.248852 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 29 08:04:50.248852 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 08:04:50.248852 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 29 08:04:50.248852 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:04:50.248852 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 08:04:50.248852 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 08:04:50.248852 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 08:04:50.248852 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 08:04:50.248852 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 5f4ae39b-5298-4fd2-bfe2-94276ba4a1bc could not be found. Jun 29 08:04:50.248852 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 29 08:04:50.248852 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-9b8d93ed-2494-480e-87c7-c2a7a43f028d tempest-VolumesGetTestJSON-1173458071 tempest-VolumesGetTestJSON-1173458071-project] Returning 404 to user: Volume 5f4ae39b-5298-4fd2-bfe2-94276ba4a1bc could not be found. {{(pid=117889) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 08:04:50.248852 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-9b8d93ed-2494-480e-87c7-c2a7a43f028d tempest-VolumesGetTestJSON-1173458071 tempest-VolumesGetTestJSON-1173458071-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/5f4ae39b-5298-4fd2-bfe2-94276ba4a1bc" status: 404 len: 109 microversion: 2.1 time: 0.086264 Jun 29 08:04:50.248852 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 100/201] 10.222.0.43 () {58 vars in 1244 bytes} [Wed Jun 29 08:04:50 2022] GET /compute/v2.1/os-volumes/5f4ae39b-5298-4fd2-bfe2-94276ba4a1bc => generated 109 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 29 08:04:50.498228 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-7b12a07f-888f-4418-a410-6a206e66ed24 tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:04:50.499211 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-7b12a07f-888f-4418-a410-6a206e66ed24 tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] [instance: 2e99307a-e437-4e8d-821c-319cc555e209] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:04:50.510060 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-7b12a07f-888f-4418-a410-6a206e66ed24 tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:04:50.511065 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-7b12a07f-888f-4418-a410-6a206e66ed24 tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:04:50.512316 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-7b12a07f-888f-4418-a410-6a206e66ed24 tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:04:50.513130 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-7b12a07f-888f-4418-a410-6a206e66ed24 tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:04:51.011025 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-fb9b8762-e599-4749-a8da-47cce97de69a tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:04:51.011669 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-fb9b8762-e599-4749-a8da-47cce97de69a tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] [instance: d5d97f9b-3f4a-4a5e-89e8-98d55412fe71] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:04:51.024107 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-fb9b8762-e599-4749-a8da-47cce97de69a tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:04:51.024561 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-fb9b8762-e599-4749-a8da-47cce97de69a tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:04:51.031974 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-fb9b8762-e599-4749-a8da-47cce97de69a tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:04:51.032762 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-fb9b8762-e599-4749-a8da-47cce97de69a tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:04:51.109174 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-fb9b8762-e599-4749-a8da-47cce97de69a tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] 10.222.0.43 "GET /compute/v2.1/servers/d5d97f9b-3f4a-4a5e-89e8-98d55412fe71/ips" status: 200 len: 146 microversion: 2.1 time: 0.109094 Jun 29 08:04:51.110164 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 101/202] 10.222.0.43 () {58 vars in 1247 bytes} [Wed Jun 29 08:04:50 2022] GET /compute/v2.1/servers/d5d97f9b-3f4a-4a5e-89e8-98d55412fe71/ips => generated 146 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:04:51.194903 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-1ab38fb9-c650-4610-9716-75baa048271c tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:04:51.196382 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-1ab38fb9-c650-4610-9716-75baa048271c tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] [instance: 79765057-c430-4292-bc5f-ee0c6a66b367] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:04:51.214238 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-1ab38fb9-c650-4610-9716-75baa048271c tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:04:51.219150 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-1ab38fb9-c650-4610-9716-75baa048271c tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:04:51.220138 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-1ab38fb9-c650-4610-9716-75baa048271c tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:04:51.223879 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-1ab38fb9-c650-4610-9716-75baa048271c tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:04:51.512236 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-7b12a07f-888f-4418-a410-6a206e66ed24 tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1feaba97f594ffda9dd2962bebdc082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdadf97d44048c3bec51c0ae58ee4a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:04:51.526187 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-7b12a07f-888f-4418-a410-6a206e66ed24 tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] 10.222.0.43 "GET /compute/v2.1/servers/2e99307a-e437-4e8d-821c-319cc555e209" status: 200 len: 1318 microversion: 2.1 time: 1.033234 Jun 29 08:04:51.530291 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 102/203] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:04:50 2022] GET /compute/v2.1/servers/2e99307a-e437-4e8d-821c-319cc555e209 => generated 1318 bytes in 1038 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:04:51.677324 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-1ab38fb9-c650-4610-9716-75baa048271c tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4af4eedee24897be2e702ef51873b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab693125979f4bb7b7b3c94061610fe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:04:51.695221 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-1ab38fb9-c650-4610-9716-75baa048271c tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] 10.222.0.43 "GET /compute/v2.1/servers/79765057-c430-4292-bc5f-ee0c6a66b367" status: 200 len: 1522 microversion: 2.1 time: 0.510804 Jun 29 08:04:51.700719 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 102/204] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:04:51 2022] GET /compute/v2.1/servers/79765057-c430-4292-bc5f-ee0c6a66b367 => generated 1522 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 08:04:52.559771 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-e0580973-ad8f-45e5-8e26-14e0ff0437c6 tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:04:52.560774 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-e0580973-ad8f-45e5-8e26-14e0ff0437c6 tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] [instance: 2e99307a-e437-4e8d-821c-319cc555e209] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:04:52.587324 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-e0580973-ad8f-45e5-8e26-14e0ff0437c6 tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:04:52.588134 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-e0580973-ad8f-45e5-8e26-14e0ff0437c6 tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:04:52.589547 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-e0580973-ad8f-45e5-8e26-14e0ff0437c6 tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:04:52.590349 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-e0580973-ad8f-45e5-8e26-14e0ff0437c6 tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:04:52.735034 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-426611b2-3740-47aa-bb26-924867231732 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:04:52.741021 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-426611b2-3740-47aa-bb26-924867231732 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] [instance: 79765057-c430-4292-bc5f-ee0c6a66b367] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:04:52.779605 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-426611b2-3740-47aa-bb26-924867231732 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:04:52.781511 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-426611b2-3740-47aa-bb26-924867231732 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:04:52.790026 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-426611b2-3740-47aa-bb26-924867231732 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:04:52.803829 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-426611b2-3740-47aa-bb26-924867231732 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:04:53.160018 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-426611b2-3740-47aa-bb26-924867231732 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4af4eedee24897be2e702ef51873b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab693125979f4bb7b7b3c94061610fe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:04:53.213748 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-426611b2-3740-47aa-bb26-924867231732 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] 10.222.0.43 "GET /compute/v2.1/servers/79765057-c430-4292-bc5f-ee0c6a66b367" status: 200 len: 1522 microversion: 2.1 time: 0.488070 Jun 29 08:04:53.216346 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 103/205] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:04:52 2022] GET /compute/v2.1/servers/79765057-c430-4292-bc5f-ee0c6a66b367 => generated 1522 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:04:53.420210 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-e0580973-ad8f-45e5-8e26-14e0ff0437c6 tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1feaba97f594ffda9dd2962bebdc082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdadf97d44048c3bec51c0ae58ee4a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:04:53.435631 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-e0580973-ad8f-45e5-8e26-14e0ff0437c6 tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] 10.222.0.43 "GET /compute/v2.1/servers/2e99307a-e437-4e8d-821c-319cc555e209" status: 200 len: 1318 microversion: 2.1 time: 0.884248 Jun 29 08:04:53.436237 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 103/206] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:04:52 2022] GET /compute/v2.1/servers/2e99307a-e437-4e8d-821c-319cc555e209 => generated 1318 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:04:53.871714 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-e3c7b791-eabd-44a5-be16-54af65d076ae tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "81101dbd-fd70-4464-9dba-c192c718e8ab"}} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:04:53.875636 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-e3c7b791-eabd-44a5-be16-54af65d076ae tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] [instance: d5d97f9b-3f4a-4a5e-89e8-98d55412fe71] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:04:53.890865 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e3c7b791-eabd-44a5-be16-54af65d076ae tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:04:53.892290 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e3c7b791-eabd-44a5-be16-54af65d076ae tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:04:53.894173 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e3c7b791-eabd-44a5-be16-54af65d076ae tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:04:53.896553 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e3c7b791-eabd-44a5-be16-54af65d076ae tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:04:54.248422 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-10bcd326-4bcd-4f5a-9efa-85650e5863cb tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:04:54.252116 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-10bcd326-4bcd-4f5a-9efa-85650e5863cb tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] [instance: 79765057-c430-4292-bc5f-ee0c6a66b367] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:04:54.264083 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG dbcounter [-] [117890] Writing DB stats nova_api:SELECT=38 {{(pid=117890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:04:54.277574 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-10bcd326-4bcd-4f5a-9efa-85650e5863cb tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:04:54.278765 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-10bcd326-4bcd-4f5a-9efa-85650e5863cb tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:04:54.280542 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-10bcd326-4bcd-4f5a-9efa-85650e5863cb tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:04:54.288659 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-10bcd326-4bcd-4f5a-9efa-85650e5863cb tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:04:54.736292 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-10bcd326-4bcd-4f5a-9efa-85650e5863cb tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4af4eedee24897be2e702ef51873b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab693125979f4bb7b7b3c94061610fe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:04:54.768009 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-10bcd326-4bcd-4f5a-9efa-85650e5863cb tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] 10.222.0.43 "GET /compute/v2.1/servers/79765057-c430-4292-bc5f-ee0c6a66b367" status: 200 len: 1502 microversion: 2.1 time: 0.524333 Jun 29 08:04:54.772604 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 104/207] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:04:54 2022] GET /compute/v2.1/servers/79765057-c430-4292-bc5f-ee0c6a66b367 => generated 1502 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:04:54.782366 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-e3c7b791-eabd-44a5-be16-54af65d076ae tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] 10.222.0.43 "POST /compute/v2.1/servers/d5d97f9b-3f4a-4a5e-89e8-98d55412fe71/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.917736 Jun 29 08:04:54.787235 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 104/208] 10.222.0.43 () {60 vars in 1322 bytes} [Wed Jun 29 08:04:53 2022] POST /compute/v2.1/servers/d5d97f9b-3f4a-4a5e-89e8-98d55412fe71/os-volume_attachments => generated 194 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:04:54.794304 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-860b2e9f-473b-41b0-8d94-f81f1522c5c1 tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:04:54.795611 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-860b2e9f-473b-41b0-8d94-f81f1522c5c1 tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] [instance: 2e99307a-e437-4e8d-821c-319cc555e209] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:04:54.802922 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-7063cac0-1547-4e08-b789-1e3f34de9175 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a13f15ba-de80-45ca-9b48-aac5d390b844"}} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:04:54.804129 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-7063cac0-1547-4e08-b789-1e3f34de9175 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] [instance: 79765057-c430-4292-bc5f-ee0c6a66b367] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:04:54.814018 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-860b2e9f-473b-41b0-8d94-f81f1522c5c1 tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:04:54.815415 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-860b2e9f-473b-41b0-8d94-f81f1522c5c1 tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:04:54.817524 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-860b2e9f-473b-41b0-8d94-f81f1522c5c1 tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:04:54.819014 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-860b2e9f-473b-41b0-8d94-f81f1522c5c1 tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:04:54.826731 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-7063cac0-1547-4e08-b789-1e3f34de9175 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:04:54.827969 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-7063cac0-1547-4e08-b789-1e3f34de9175 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:04:54.830013 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-7063cac0-1547-4e08-b789-1e3f34de9175 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:04:54.831407 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-7063cac0-1547-4e08-b789-1e3f34de9175 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:04:54.912294 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.wsgi [None req-7063cac0-1547-4e08-b789-1e3f34de9175 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] HTTP exception thrown: Cannot 'attach_volume' instance 79765057-c430-4292-bc5f-ee0c6a66b367 while it is in vm_state rescued Jun 29 08:04:54.929984 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-7063cac0-1547-4e08-b789-1e3f34de9175 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Request method failure captured: Jun 29 08:04:54.929984 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: request: POST /compute/v2.1/servers/79765057-c430-4292-bc5f-ee0c6a66b367/os-volume_attachments HTTP/1.1 Jun 29 08:04:54.929984 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: Accept: application/json Jun 29 08:04:54.929984 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: Accept-Encoding: identity Jun 29 08:04:54.929984 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: Connection: close Jun 29 08:04:54.929984 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: Content-Length: 74 Jun 29 08:04:54.929984 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: Content-Type: application/json Jun 29 08:04:54.929984 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: Host: 10.222.0.43 Jun 29 08:04:54.929984 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: Openstack-System-Scope: None Jun 29 08:04:54.929984 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: User-Agent: python-urllib3/1.26.9 Jun 29 08:04:54.929984 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Auth-Token: gAAAAABivAcrRGv8n-hBTzbO-mvdA9ZuWTSzlFAkKkndDN8FN_iXGvsZd7rjQm_nN6TZnE7JfsJp8_xcKjzwxgIiNSK_dDCsCpCeOaZ_u5KXcRULb_0_OxKetSiSEtrbxD9wcdC3B0H-F_SoNZ4yDrjB8_rwxeM6bFtzhz_78UcZZraaffHkiVk Jun 29 08:04:54.929984 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Domain-Id: None Jun 29 08:04:54.929984 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Domain-Name: None Jun 29 08:04:54.929984 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Identity-Status: Confirmed Jun 29 08:04:54.929984 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Is-Admin-Project: True Jun 29 08:04:54.929984 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Project-Domain-Id: default Jun 29 08:04:54.929984 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Project-Domain-Name: Default Jun 29 08:04:54.929984 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Project-Id: ab693125979f4bb7b7b3c94061610fe2 Jun 29 08:04:54.929984 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-796076534 Jun 29 08:04:54.929984 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Role: member,reader Jun 29 08:04:54.929984 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Roles: member,reader Jun 29 08:04:54.931849 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/ab693125979f4bb7b7b3c94061610fe2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_ab693125979f4bb7b7b3c94061610fe2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/ab693125979f4bb7b7b3c94061610fe2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/ab693125979f4bb7b7b3c94061610fe2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Jun 29 08:04:54.931849 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Tenant: tempest-ServerRescueNegativeTestJSON-796076534 Jun 29 08:04:54.931849 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Tenant-Id: ab693125979f4bb7b7b3c94061610fe2 Jun 29 08:04:54.931849 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-796076534 Jun 29 08:04:54.931849 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-User: tempest-ServerRescueNegativeTestJSON-796076534-project Jun 29 08:04:54.931849 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-User-Domain-Id: default Jun 29 08:04:54.931849 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-User-Domain-Name: Default Jun 29 08:04:54.931849 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-User-Id: 1f4af4eedee24897be2e702ef51873b3 Jun 29 08:04:54.931849 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-User-Name: tempest-ServerRescueNegativeTestJSON-796076534-project Jun 29 08:04:54.931849 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: Jun 29 08:04:54.931849 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: {"volumeAttachment": {"volumeId": "a13f15ba-de80-45ca-9b48-aac5d390b844"}} Jun 29 08:04:54.931849 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: method: > Jun 29 08:04:54.932859 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: exception: Cannot 'attach_volume' instance 79765057-c430-4292-bc5f-ee0c6a66b367 while it is in vm_state rescued Jun 29 08:04:54.932859 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: action_args: {'server_id': '79765057-c430-4292-bc5f-ee0c6a66b367', 'body': {'volumeAttachment': {'volumeId': 'a13f15ba-de80-45ca-9b48-aac5d390b844'}}} Jun 29 08:04:54.932859 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 08:04:54.932859 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:04:54.932859 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 29 08:04:54.932859 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 29 08:04:54.932859 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 29 08:04:54.932859 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 29 08:04:54.932859 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 29 08:04:54.932859 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 29 08:04:54.932859 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 79765057-c430-4292-bc5f-ee0c6a66b367 in vm_state rescued. Cannot attach_volume while the instance is in this state. Jun 29 08:04:54.932859 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 29 08:04:54.932859 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 08:04:54.932859 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 29 08:04:54.932859 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:04:54.932859 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 08:04:54.932859 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 08:04:54.932859 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 08:04:54.932859 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 08:04:54.935734 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 08:04:54.935734 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 08:04:54.935734 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 29 08:04:54.935734 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 29 08:04:54.935734 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 29 08:04:54.935734 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 29 08:04:54.935734 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 29 08:04:54.935734 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 29 08:04:54.935734 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jun 29 08:04:54.935734 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 29 08:04:54.935734 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 29 08:04:54.935734 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 29 08:04:54.935734 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 79765057-c430-4292-bc5f-ee0c6a66b367 while it is in vm_state rescued Jun 29 08:04:54.935734 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 29 08:04:54.935734 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 08:04:54.935734 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 29 08:04:54.935734 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:04:54.935734 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 08:04:54.935734 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 08:04:54.938603 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 08:04:54.938603 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 08:04:54.938603 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 79765057-c430-4292-bc5f-ee0c6a66b367 while it is in vm_state rescued Jun 29 08:04:54.938603 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 29 08:04:54.943001 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-7063cac0-1547-4e08-b789-1e3f34de9175 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Returning 409 to user: Cannot 'attach_volume' instance 79765057-c430-4292-bc5f-ee0c6a66b367 while it is in vm_state rescued {{(pid=117889) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 08:04:54.944908 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-7063cac0-1547-4e08-b789-1e3f34de9175 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] 10.222.0.43 "POST /compute/v2.1/servers/79765057-c430-4292-bc5f-ee0c6a66b367/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.147312 Jun 29 08:04:54.948642 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 105/209] 10.222.0.43 () {60 vars in 1322 bytes} [Wed Jun 29 08:04:54 2022] POST /compute/v2.1/servers/79765057-c430-4292-bc5f-ee0c6a66b367/os-volume_attachments => generated 152 bytes in 151 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 29 08:04:54.960663 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-e51a8c3e-1dce-480c-ac57-0679d753f6c6 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:04:54.964867 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-e51a8c3e-1dce-480c-ac57-0679d753f6c6 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] [instance: f99567d1-cadf-40c5-b1dc-f86739b2b16c] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:04:54.982953 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e51a8c3e-1dce-480c-ac57-0679d753f6c6 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:04:54.984744 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e51a8c3e-1dce-480c-ac57-0679d753f6c6 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:04:54.985934 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e51a8c3e-1dce-480c-ac57-0679d753f6c6 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:04:54.988185 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e51a8c3e-1dce-480c-ac57-0679d753f6c6 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:04:55.069567 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-e51a8c3e-1dce-480c-ac57-0679d753f6c6 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] 10.222.0.43 "GET /compute/v2.1/servers/f99567d1-cadf-40c5-b1dc-f86739b2b16c/ips" status: 200 len: 152 microversion: 2.20 time: 0.118671 Jun 29 08:04:55.082002 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 106/210] 10.222.0.43 () {60 vars in 1288 bytes} [Wed Jun 29 08:04:54 2022] GET /compute/v2.1/servers/f99567d1-cadf-40c5-b1dc-f86739b2b16c/ips => generated 152 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 29 08:04:55.095190 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-d7b893bc-31bb-4957-b383-54c9c49549f4 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:04:55.097208 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-d7b893bc-31bb-4957-b383-54c9c49549f4 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] [instance: 79765057-c430-4292-bc5f-ee0c6a66b367] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:04:55.115363 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-d7b893bc-31bb-4957-b383-54c9c49549f4 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:04:55.116191 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-d7b893bc-31bb-4957-b383-54c9c49549f4 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:04:55.117654 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-d7b893bc-31bb-4957-b383-54c9c49549f4 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:04:55.118465 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-d7b893bc-31bb-4957-b383-54c9c49549f4 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:04:55.391701 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-860b2e9f-473b-41b0-8d94-f81f1522c5c1 tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1feaba97f594ffda9dd2962bebdc082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdadf97d44048c3bec51c0ae58ee4a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:04:55.401868 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-d7b893bc-31bb-4957-b383-54c9c49549f4 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] 10.222.0.43 "POST /compute/v2.1/servers/79765057-c430-4292-bc5f-ee0c6a66b367/action" status: 202 len: 0 microversion: 2.1 time: 0.316864 Jun 29 08:04:55.403569 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 107/211] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Jun 29 08:04:55 2022] POST /compute/v2.1/servers/79765057-c430-4292-bc5f-ee0c6a66b367/action => generated 0 bytes in 321 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 29 08:04:55.423912 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-ac981ce1-3f4a-4b5e-9bd4-8751cdb54a0f tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:04:55.428014 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-ac981ce1-3f4a-4b5e-9bd4-8751cdb54a0f tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] [instance: 79765057-c430-4292-bc5f-ee0c6a66b367] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:04:55.440536 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-860b2e9f-473b-41b0-8d94-f81f1522c5c1 tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] 10.222.0.43 "GET /compute/v2.1/servers/2e99307a-e437-4e8d-821c-319cc555e209" status: 200 len: 1318 microversion: 2.1 time: 0.665529 Jun 29 08:04:55.451534 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ac981ce1-3f4a-4b5e-9bd4-8751cdb54a0f tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:04:55.453043 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ac981ce1-3f4a-4b5e-9bd4-8751cdb54a0f tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:04:55.453430 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 105/212] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:04:54 2022] GET /compute/v2.1/servers/2e99307a-e437-4e8d-821c-319cc555e209 => generated 1318 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:04:55.459254 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ac981ce1-3f4a-4b5e-9bd4-8751cdb54a0f tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:04:55.460479 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ac981ce1-3f4a-4b5e-9bd4-8751cdb54a0f tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:04:56.472056 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-091a0589-ebf3-4087-bd2a-1f749747365e tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:04:56.473649 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-091a0589-ebf3-4087-bd2a-1f749747365e tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] [instance: 2e99307a-e437-4e8d-821c-319cc555e209] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:04:56.493701 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-091a0589-ebf3-4087-bd2a-1f749747365e tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:04:56.495298 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-091a0589-ebf3-4087-bd2a-1f749747365e tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:04:56.499081 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-091a0589-ebf3-4087-bd2a-1f749747365e tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:04:56.501773 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-091a0589-ebf3-4087-bd2a-1f749747365e tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:04:56.510897 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-ac981ce1-3f4a-4b5e-9bd4-8751cdb54a0f tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4af4eedee24897be2e702ef51873b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab693125979f4bb7b7b3c94061610fe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:04:56.539173 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-ac981ce1-3f4a-4b5e-9bd4-8751cdb54a0f tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] 10.222.0.43 "GET /compute/v2.1/servers/79765057-c430-4292-bc5f-ee0c6a66b367" status: 200 len: 1510 microversion: 2.1 time: 1.126590 Jun 29 08:04:56.549378 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 108/213] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:04:55 2022] GET /compute/v2.1/servers/79765057-c430-4292-bc5f-ee0c6a66b367 => generated 1510 bytes in 1134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:04:56.590167 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [req-693102cc-4461-42de-b5b6-015ba9af6c5e req-d7f4d68b-5030-4d43-8bac-1b088fcb25de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e99307a-e437-4e8d-821c-319cc555e209", "name": "network-vif-plugged", "status": "completed", "tag": "dec20ad0-8f1a-494a-ad93-6642576929a5"}]} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:04:56.626668 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-693102cc-4461-42de-b5b6-015ba9af6c5e req-d7f4d68b-5030-4d43-8bac-1b088fcb25de service nova] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:04:56.627464 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-693102cc-4461-42de-b5b6-015ba9af6c5e req-d7f4d68b-5030-4d43-8bac-1b088fcb25de service nova] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:04:56.652620 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.compute.server_external_events [req-693102cc-4461-42de-b5b6-015ba9af6c5e req-d7f4d68b-5030-4d43-8bac-1b088fcb25de service nova] Creating event network-vif-plugged:dec20ad0-8f1a-494a-ad93-6642576929a5 for instance 2e99307a-e437-4e8d-821c-319cc555e209 on hv-cinder-76810 Jun 29 08:04:56.660090 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [req-693102cc-4461-42de-b5b6-015ba9af6c5e req-d7f4d68b-5030-4d43-8bac-1b088fcb25de service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084688 Jun 29 08:04:56.662561 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 109/214] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jun 29 08:04:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:04:57.455452 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-091a0589-ebf3-4087-bd2a-1f749747365e tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1feaba97f594ffda9dd2962bebdc082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdadf97d44048c3bec51c0ae58ee4a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:04:57.469976 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-091a0589-ebf3-4087-bd2a-1f749747365e tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] 10.222.0.43 "GET /compute/v2.1/servers/2e99307a-e437-4e8d-821c-319cc555e209" status: 200 len: 1318 microversion: 2.1 time: 1.002167 Jun 29 08:04:57.476299 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 106/215] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:04:56 2022] GET /compute/v2.1/servers/2e99307a-e437-4e8d-821c-319cc555e209 => generated 1318 bytes in 1010 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:04:57.581262 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-9890d923-5db2-49c9-97e1-ea2aeb33e14f tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:04:57.585045 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-9890d923-5db2-49c9-97e1-ea2aeb33e14f tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] [instance: 79765057-c430-4292-bc5f-ee0c6a66b367] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:04:57.615568 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-9890d923-5db2-49c9-97e1-ea2aeb33e14f tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:04:57.622665 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-9890d923-5db2-49c9-97e1-ea2aeb33e14f tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:04:57.632673 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-9890d923-5db2-49c9-97e1-ea2aeb33e14f tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:04:57.635399 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-9890d923-5db2-49c9-97e1-ea2aeb33e14f tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:04:58.095597 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-b09f9c69-c13c-4a87-b73b-c5405e54c2d8 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:04:58.096504 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-b09f9c69-c13c-4a87-b73b-c5405e54c2d8 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] [instance: f99567d1-cadf-40c5-b1dc-f86739b2b16c] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:04:58.115758 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-b09f9c69-c13c-4a87-b73b-c5405e54c2d8 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:04:58.116503 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-b09f9c69-c13c-4a87-b73b-c5405e54c2d8 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:04:58.119275 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-b09f9c69-c13c-4a87-b73b-c5405e54c2d8 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:04:58.119976 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-b09f9c69-c13c-4a87-b73b-c5405e54c2d8 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:04:58.148608 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-9890d923-5db2-49c9-97e1-ea2aeb33e14f tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4af4eedee24897be2e702ef51873b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab693125979f4bb7b7b3c94061610fe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:04:58.170697 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-9890d923-5db2-49c9-97e1-ea2aeb33e14f tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] 10.222.0.43 "GET /compute/v2.1/servers/79765057-c430-4292-bc5f-ee0c6a66b367" status: 200 len: 1510 microversion: 2.1 time: 0.613928 Jun 29 08:04:58.171988 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 110/216] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:04:57 2022] GET /compute/v2.1/servers/79765057-c430-4292-bc5f-ee0c6a66b367 => generated 1510 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:04:58.174089 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.objects.instance [None req-b09f9c69-c13c-4a87-b73b-c5405e54c2d8 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lazy-loading 'flavor' on Instance uuid f99567d1-cadf-40c5-b1dc-f86739b2b16c {{(pid=117890) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 29 08:04:58.518854 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-9ad5fb39-2552-4f49-8001-b322c4f7f5f9 tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:04:58.522378 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-9ad5fb39-2552-4f49-8001-b322c4f7f5f9 tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] [instance: 2e99307a-e437-4e8d-821c-319cc555e209] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:04:58.545280 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-9ad5fb39-2552-4f49-8001-b322c4f7f5f9 tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:04:58.557046 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-9ad5fb39-2552-4f49-8001-b322c4f7f5f9 tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:04:58.557046 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-9ad5fb39-2552-4f49-8001-b322c4f7f5f9 tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:04:58.557046 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-9ad5fb39-2552-4f49-8001-b322c4f7f5f9 tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:04:59.286260 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-b09f9c69-c13c-4a87-b73b-c5405e54c2d8 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] 10.222.0.43 "POST /compute/v2.1/servers/f99567d1-cadf-40c5-b1dc-f86739b2b16c/action" status: 202 len: 0 microversion: 2.20 time: 1.195004 Jun 29 08:04:59.291497 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 107/217] 10.222.0.43 () {62 vars in 1318 bytes} [Wed Jun 29 08:04:58 2022] POST /compute/v2.1/servers/f99567d1-cadf-40c5-b1dc-f86739b2b16c/action => generated 0 bytes in 1204 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 29 08:04:59.315399 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-e4926ee9-28ea-4927-9141-e654e878df94 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:04:59.316320 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-e4926ee9-28ea-4927-9141-e654e878df94 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] [instance: 79765057-c430-4292-bc5f-ee0c6a66b367] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:04:59.341972 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-e4926ee9-28ea-4927-9141-e654e878df94 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:04:59.342963 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-e4926ee9-28ea-4927-9141-e654e878df94 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:04:59.343996 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-e4926ee9-28ea-4927-9141-e654e878df94 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:04:59.345654 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-e4926ee9-28ea-4927-9141-e654e878df94 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:04:59.821352 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-e4926ee9-28ea-4927-9141-e654e878df94 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4af4eedee24897be2e702ef51873b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab693125979f4bb7b7b3c94061610fe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:04:59.829550 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-9ad5fb39-2552-4f49-8001-b322c4f7f5f9 tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1feaba97f594ffda9dd2962bebdc082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdadf97d44048c3bec51c0ae58ee4a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:04:59.842628 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-9ad5fb39-2552-4f49-8001-b322c4f7f5f9 tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] 10.222.0.43 "GET /compute/v2.1/servers/2e99307a-e437-4e8d-821c-319cc555e209" status: 200 len: 1318 microversion: 2.1 time: 1.333757 Jun 29 08:04:59.843457 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 111/218] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:04:58 2022] GET /compute/v2.1/servers/2e99307a-e437-4e8d-821c-319cc555e209 => generated 1318 bytes in 1337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 08:04:59.856841 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-3b462da4-4926-4173-a9b4-288751828db2 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:04:59.857496 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-3b462da4-4926-4173-a9b4-288751828db2 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] [instance: f99567d1-cadf-40c5-b1dc-f86739b2b16c] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:04:59.865639 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-e4926ee9-28ea-4927-9141-e654e878df94 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] 10.222.0.43 "GET /compute/v2.1/servers/79765057-c430-4292-bc5f-ee0c6a66b367" status: 200 len: 1510 microversion: 2.1 time: 0.572161 Jun 29 08:04:59.887747 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 108/219] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:04:59 2022] GET /compute/v2.1/servers/79765057-c430-4292-bc5f-ee0c6a66b367 => generated 1510 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:04:59.895761 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-3b462da4-4926-4173-a9b4-288751828db2 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:04:59.898667 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-3b462da4-4926-4173-a9b4-288751828db2 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:04:59.900004 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-3b462da4-4926-4173-a9b4-288751828db2 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:04:59.900459 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-3b462da4-4926-4173-a9b4-288751828db2 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:05:00.376188 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-3b462da4-4926-4173-a9b4-288751828db2 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:05:00.432606 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-3b462da4-4926-4173-a9b4-288751828db2 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:05:00.447316 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-3b462da4-4926-4173-a9b4-288751828db2 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:05:00.451388 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-3b462da4-4926-4173-a9b4-288751828db2 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] 10.222.0.43 "GET /compute/v2.1/servers/f99567d1-cadf-40c5-b1dc-f86739b2b16c" status: 200 len: 1725 microversion: 2.20 time: 0.603601 Jun 29 08:05:00.465084 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 112/220] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 29 08:04:59 2022] GET /compute/v2.1/servers/f99567d1-cadf-40c5-b1dc-f86739b2b16c => generated 1725 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:05:00.873231 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-e8cba217-8b48-46b3-9b42-ed8b64c66cfb tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:05:00.874094 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-e8cba217-8b48-46b3-9b42-ed8b64c66cfb tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] [instance: 2e99307a-e437-4e8d-821c-319cc555e209] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:05:00.889089 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-e8cba217-8b48-46b3-9b42-ed8b64c66cfb tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:05:00.893889 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-e8cba217-8b48-46b3-9b42-ed8b64c66cfb tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:05:00.896841 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-94829c3f-1d7c-4351-9914-1937125721d9 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:05:00.906579 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-e8cba217-8b48-46b3-9b42-ed8b64c66cfb tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:05:00.907281 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-e8cba217-8b48-46b3-9b42-ed8b64c66cfb tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:05:00.909564 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-94829c3f-1d7c-4351-9914-1937125721d9 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] [instance: 79765057-c430-4292-bc5f-ee0c6a66b367] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:05:00.919187 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=3 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:05:00.948401 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-94829c3f-1d7c-4351-9914-1937125721d9 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:05:00.949793 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-94829c3f-1d7c-4351-9914-1937125721d9 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:05:00.951538 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-94829c3f-1d7c-4351-9914-1937125721d9 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:05:00.957286 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-94829c3f-1d7c-4351-9914-1937125721d9 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:05:01.229157 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-e8cba217-8b48-46b3-9b42-ed8b64c66cfb tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1feaba97f594ffda9dd2962bebdc082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdadf97d44048c3bec51c0ae58ee4a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:05:01.252202 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-e8cba217-8b48-46b3-9b42-ed8b64c66cfb tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] 10.222.0.43 "GET /compute/v2.1/servers/2e99307a-e437-4e8d-821c-319cc555e209" status: 200 len: 1506 microversion: 2.1 time: 0.383036 Jun 29 08:05:01.257180 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 109/221] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:05:00 2022] GET /compute/v2.1/servers/2e99307a-e437-4e8d-821c-319cc555e209 => generated 1506 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:05:01.483473 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-3318bdc3-1e44-4490-bcb6-b748d3d672de tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:05:01.508545 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-3318bdc3-1e44-4490-bcb6-b748d3d672de tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] [instance: f99567d1-cadf-40c5-b1dc-f86739b2b16c] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:05:01.515648 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-3318bdc3-1e44-4490-bcb6-b748d3d672de tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:05:01.516233 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-3318bdc3-1e44-4490-bcb6-b748d3d672de tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:05:01.517045 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-3318bdc3-1e44-4490-bcb6-b748d3d672de tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:05:01.517574 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-3318bdc3-1e44-4490-bcb6-b748d3d672de tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:05:01.985617 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-94829c3f-1d7c-4351-9914-1937125721d9 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4af4eedee24897be2e702ef51873b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab693125979f4bb7b7b3c94061610fe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:05:01.999470 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-94829c3f-1d7c-4351-9914-1937125721d9 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] 10.222.0.43 "GET /compute/v2.1/servers/79765057-c430-4292-bc5f-ee0c6a66b367" status: 200 len: 1510 microversion: 2.1 time: 1.110804 Jun 29 08:05:02.000775 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 113/222] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:05:00 2022] GET /compute/v2.1/servers/79765057-c430-4292-bc5f-ee0c6a66b367 => generated 1510 bytes in 1113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 08:05:02.617179 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-3318bdc3-1e44-4490-bcb6-b748d3d672de tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:05:02.648205 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-3318bdc3-1e44-4490-bcb6-b748d3d672de tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:05:02.662558 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-3318bdc3-1e44-4490-bcb6-b748d3d672de tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:05:02.664890 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-3318bdc3-1e44-4490-bcb6-b748d3d672de tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] 10.222.0.43 "GET /compute/v2.1/servers/f99567d1-cadf-40c5-b1dc-f86739b2b16c" status: 200 len: 1725 microversion: 2.20 time: 1.188563 Jun 29 08:05:02.670743 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 110/223] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 29 08:05:01 2022] GET /compute/v2.1/servers/f99567d1-cadf-40c5-b1dc-f86739b2b16c => generated 1725 bytes in 1195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 29 08:05:03.021523 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-ad25eb50-4d04-4a79-8e73-1c0ca4922a82 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:05:03.022902 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-ad25eb50-4d04-4a79-8e73-1c0ca4922a82 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] [instance: 79765057-c430-4292-bc5f-ee0c6a66b367] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:05:03.036086 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ad25eb50-4d04-4a79-8e73-1c0ca4922a82 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:05:03.048945 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ad25eb50-4d04-4a79-8e73-1c0ca4922a82 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:05:03.052369 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ad25eb50-4d04-4a79-8e73-1c0ca4922a82 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:05:03.057642 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ad25eb50-4d04-4a79-8e73-1c0ca4922a82 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:05:03.132076 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:05:03.684544 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-ad25eb50-4d04-4a79-8e73-1c0ca4922a82 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4af4eedee24897be2e702ef51873b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab693125979f4bb7b7b3c94061610fe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:05:03.696401 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-9135e9f7-9751-4a85-871b-ac0888829365 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:05:03.697611 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-9135e9f7-9751-4a85-871b-ac0888829365 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] [instance: f99567d1-cadf-40c5-b1dc-f86739b2b16c] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:05:03.734039 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-ad25eb50-4d04-4a79-8e73-1c0ca4922a82 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] 10.222.0.43 "GET /compute/v2.1/servers/79765057-c430-4292-bc5f-ee0c6a66b367" status: 200 len: 1516 microversion: 2.1 time: 0.718072 Jun 29 08:05:03.757451 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 114/224] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:05:03 2022] GET /compute/v2.1/servers/79765057-c430-4292-bc5f-ee0c6a66b367 => generated 1516 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:05:03.757705 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-9135e9f7-9751-4a85-871b-ac0888829365 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:05:03.758331 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-9135e9f7-9751-4a85-871b-ac0888829365 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:05:03.760373 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-9135e9f7-9751-4a85-871b-ac0888829365 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:05:03.761526 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-9135e9f7-9751-4a85-871b-ac0888829365 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:05:04.420699 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-9135e9f7-9751-4a85-871b-ac0888829365 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:05:04.468968 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-9135e9f7-9751-4a85-871b-ac0888829365 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:05:04.529896 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-9135e9f7-9751-4a85-871b-ac0888829365 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:05:04.535886 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-9135e9f7-9751-4a85-871b-ac0888829365 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] 10.222.0.43 "GET /compute/v2.1/servers/f99567d1-cadf-40c5-b1dc-f86739b2b16c" status: 200 len: 1725 microversion: 2.20 time: 0.844812 Jun 29 08:05:04.553834 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 111/225] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 29 08:05:03 2022] GET /compute/v2.1/servers/f99567d1-cadf-40c5-b1dc-f86739b2b16c => generated 1725 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:05:04.718726 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-ce598260-981c-4440-8485-225288daafbd tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:05:04.743904 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ce598260-981c-4440-8485-225288daafbd tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:05:04.744374 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ce598260-981c-4440-8485-225288daafbd tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:05:05.290063 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-ce598260-981c-4440-8485-225288daafbd tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] [instance: d5d97f9b-3f4a-4a5e-89e8-98d55412fe71] Going to try to stop instance {{(pid=117889) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 29 08:05:05.530356 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-ce598260-981c-4440-8485-225288daafbd tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] 10.222.0.43 "POST /compute/v2.1/servers/d5d97f9b-3f4a-4a5e-89e8-98d55412fe71/action" status: 202 len: 0 microversion: 2.1 time: 0.817812 Jun 29 08:05:05.533110 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 115/226] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Jun 29 08:05:04 2022] POST /compute/v2.1/servers/d5d97f9b-3f4a-4a5e-89e8-98d55412fe71/action => generated 0 bytes in 822 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 29 08:05:05.552082 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-6d083763-8ac2-4dae-8950-45ab4d0b0724 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:05:05.562494 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-6d083763-8ac2-4dae-8950-45ab4d0b0724 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] [instance: d5d97f9b-3f4a-4a5e-89e8-98d55412fe71] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:05:05.639070 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-f3daa2d1-52df-4eba-92ee-b2fe505a2595 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:05:05.649553 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-6d083763-8ac2-4dae-8950-45ab4d0b0724 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:05:05.653480 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-6d083763-8ac2-4dae-8950-45ab4d0b0724 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:05:05.664098 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-f3daa2d1-52df-4eba-92ee-b2fe505a2595 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] [instance: f99567d1-cadf-40c5-b1dc-f86739b2b16c] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:05:05.671047 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-6d083763-8ac2-4dae-8950-45ab4d0b0724 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:05:05.674033 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-6d083763-8ac2-4dae-8950-45ab4d0b0724 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:05:05.757945 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-f3daa2d1-52df-4eba-92ee-b2fe505a2595 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:05:05.760501 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-f3daa2d1-52df-4eba-92ee-b2fe505a2595 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:05:05.772725 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-f3daa2d1-52df-4eba-92ee-b2fe505a2595 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:05:05.798262 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-f3daa2d1-52df-4eba-92ee-b2fe505a2595 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:05:06.620867 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-6d083763-8ac2-4dae-8950-45ab4d0b0724 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c70c44993ab240b1a5231df4c9d550c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e0c37d941434569b3dbd07e22125210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:05:06.634474 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-6d083763-8ac2-4dae-8950-45ab4d0b0724 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] 10.222.0.43 "GET /compute/v2.1/servers/d5d97f9b-3f4a-4a5e-89e8-98d55412fe71" status: 200 len: 1723 microversion: 2.1 time: 1.088961 Jun 29 08:05:06.639437 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 112/227] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:05:05 2022] GET /compute/v2.1/servers/d5d97f9b-3f4a-4a5e-89e8-98d55412fe71 => generated 1723 bytes in 1099 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 08:05:06.677148 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-50599db7-17f2-4a21-b245-4194d584d1ca tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Action: 'create', calling method: .version_select at 0x7f724169e1f0>, body: {"keypair": {"name": "tempest-keypair-717086815", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKurlPedqNXCQJ6jxr0Weu5I/NBfhipKxj8Ndpr4pd3mnyiUfF75/YFYivLlub8ygcbH805XNigqqcy+Qy9G1GpQPgz0SFQx+nfLjyAYb06n354D9+vKsZGtqg/k/4mI8Q=="}} {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:05:06.730574 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.quota [None req-50599db7-17f2-4a21-b245-4194d584d1ca tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Getting quotas for project ab693125979f4bb7b7b3c94061610fe2. Resources: {'key_pairs'} {{(pid=117890) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 29 08:05:06.743223 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.quota [None req-50599db7-17f2-4a21-b245-4194d584d1ca tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Getting quotas for user 1f4af4eedee24897be2e702ef51873b3 and project ab693125979f4bb7b7b3c94061610fe2. Resources: {'key_pairs'} {{(pid=117890) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 29 08:05:06.807806 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-50599db7-17f2-4a21-b245-4194d584d1ca tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.135955 Jun 29 08:05:06.810204 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 113/228] 10.222.0.43 () {60 vars in 1158 bytes} [Wed Jun 29 08:05:06 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 29 08:05:07.260766 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-f3daa2d1-52df-4eba-92ee-b2fe505a2595 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:05:07.282322 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-f3daa2d1-52df-4eba-92ee-b2fe505a2595 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:05:07.284231 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-f3daa2d1-52df-4eba-92ee-b2fe505a2595 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:05:07.294650 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-f3daa2d1-52df-4eba-92ee-b2fe505a2595 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] 10.222.0.43 "GET /compute/v2.1/servers/f99567d1-cadf-40c5-b1dc-f86739b2b16c" status: 200 len: 1725 microversion: 2.20 time: 1.736180 Jun 29 08:05:07.296698 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 116/229] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 29 08:05:05 2022] GET /compute/v2.1/servers/f99567d1-cadf-40c5-b1dc-f86739b2b16c => generated 1725 bytes in 1740 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:05:07.654839 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-5920ccd8-1159-4667-b315-28ff88cae87e tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:05:07.655798 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-5920ccd8-1159-4667-b315-28ff88cae87e tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] [instance: d5d97f9b-3f4a-4a5e-89e8-98d55412fe71] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:05:07.684475 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-5920ccd8-1159-4667-b315-28ff88cae87e tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:05:07.685336 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-5920ccd8-1159-4667-b315-28ff88cae87e tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:05:07.686620 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-5920ccd8-1159-4667-b315-28ff88cae87e tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:05:07.688161 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-5920ccd8-1159-4667-b315-28ff88cae87e tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:05:08.140057 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-5920ccd8-1159-4667-b315-28ff88cae87e tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c70c44993ab240b1a5231df4c9d550c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e0c37d941434569b3dbd07e22125210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:05:08.179499 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-5920ccd8-1159-4667-b315-28ff88cae87e tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] 10.222.0.43 "GET /compute/v2.1/servers/d5d97f9b-3f4a-4a5e-89e8-98d55412fe71" status: 200 len: 1723 microversion: 2.1 time: 0.529375 Jun 29 08:05:08.186188 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 114/230] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:05:07 2022] GET /compute/v2.1/servers/d5d97f9b-3f4a-4a5e-89e8-98d55412fe71 => generated 1723 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:05:08.316556 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-8b03ff02-ac90-480e-96d5-8b7d61fd3862 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:05:08.317672 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-8b03ff02-ac90-480e-96d5-8b7d61fd3862 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] [instance: f99567d1-cadf-40c5-b1dc-f86739b2b16c] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:05:08.329388 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-8b03ff02-ac90-480e-96d5-8b7d61fd3862 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:05:08.329851 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-8b03ff02-ac90-480e-96d5-8b7d61fd3862 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:05:08.330673 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-8b03ff02-ac90-480e-96d5-8b7d61fd3862 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:05:08.331109 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-8b03ff02-ac90-480e-96d5-8b7d61fd3862 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:05:08.906009 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-8b03ff02-ac90-480e-96d5-8b7d61fd3862 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:05:08.928756 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-8b03ff02-ac90-480e-96d5-8b7d61fd3862 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:05:08.935599 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-8b03ff02-ac90-480e-96d5-8b7d61fd3862 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:05:08.939668 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-8b03ff02-ac90-480e-96d5-8b7d61fd3862 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] 10.222.0.43 "GET /compute/v2.1/servers/f99567d1-cadf-40c5-b1dc-f86739b2b16c" status: 200 len: 1725 microversion: 2.20 time: 0.627895 Jun 29 08:05:08.961718 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 117/231] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 29 08:05:08 2022] GET /compute/v2.1/servers/f99567d1-cadf-40c5-b1dc-f86739b2b16c => generated 1725 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:05:09.200887 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-9a9f3577-27d3-486c-ae5c-de8f6eb342df tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:05:09.201596 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-9a9f3577-27d3-486c-ae5c-de8f6eb342df tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] [instance: d5d97f9b-3f4a-4a5e-89e8-98d55412fe71] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:05:09.225677 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-9a9f3577-27d3-486c-ae5c-de8f6eb342df tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:05:09.234094 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-9a9f3577-27d3-486c-ae5c-de8f6eb342df tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:05:09.235026 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-9a9f3577-27d3-486c-ae5c-de8f6eb342df tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:05:09.235486 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-9a9f3577-27d3-486c-ae5c-de8f6eb342df tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:05:09.307822 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG dbcounter [-] [117890] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:05:09.967814 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-9a9f3577-27d3-486c-ae5c-de8f6eb342df tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c70c44993ab240b1a5231df4c9d550c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e0c37d941434569b3dbd07e22125210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:05:09.974906 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-b2484249-4183-410b-abe3-b8b6b1b0d5ac tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:05:09.975531 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-b2484249-4183-410b-abe3-b8b6b1b0d5ac tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] [instance: f99567d1-cadf-40c5-b1dc-f86739b2b16c] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:05:09.980695 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-9a9f3577-27d3-486c-ae5c-de8f6eb342df tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] 10.222.0.43 "GET /compute/v2.1/servers/d5d97f9b-3f4a-4a5e-89e8-98d55412fe71" status: 200 len: 1723 microversion: 2.1 time: 0.785002 Jun 29 08:05:09.990504 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-b2484249-4183-410b-abe3-b8b6b1b0d5ac tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:05:09.994875 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 115/232] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:05:09 2022] GET /compute/v2.1/servers/d5d97f9b-3f4a-4a5e-89e8-98d55412fe71 => generated 1723 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:05:09.995491 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-b2484249-4183-410b-abe3-b8b6b1b0d5ac tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:05:09.998776 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-b2484249-4183-410b-abe3-b8b6b1b0d5ac tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:05:10.013614 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-b2484249-4183-410b-abe3-b8b6b1b0d5ac tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:05:11.002761 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-09e5b192-ffcd-43ed-a626-03ab4d77fb07 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:05:11.003633 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-09e5b192-ffcd-43ed-a626-03ab4d77fb07 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] [instance: d5d97f9b-3f4a-4a5e-89e8-98d55412fe71] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:05:11.020444 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-b2484249-4183-410b-abe3-b8b6b1b0d5ac tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:05:11.036670 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-09e5b192-ffcd-43ed-a626-03ab4d77fb07 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:05:11.036965 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-b2484249-4183-410b-abe3-b8b6b1b0d5ac tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:05:11.037659 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-09e5b192-ffcd-43ed-a626-03ab4d77fb07 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:05:11.038685 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-09e5b192-ffcd-43ed-a626-03ab4d77fb07 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:05:11.040484 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-09e5b192-ffcd-43ed-a626-03ab4d77fb07 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:05:11.044009 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-b2484249-4183-410b-abe3-b8b6b1b0d5ac tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:05:11.051905 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-b2484249-4183-410b-abe3-b8b6b1b0d5ac tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] 10.222.0.43 "GET /compute/v2.1/servers/f99567d1-cadf-40c5-b1dc-f86739b2b16c" status: 200 len: 1725 microversion: 2.20 time: 1.079140 Jun 29 08:05:11.056666 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 118/233] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 29 08:05:09 2022] GET /compute/v2.1/servers/f99567d1-cadf-40c5-b1dc-f86739b2b16c => generated 1725 bytes in 1097 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:05:11.637027 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-09e5b192-ffcd-43ed-a626-03ab4d77fb07 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c70c44993ab240b1a5231df4c9d550c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e0c37d941434569b3dbd07e22125210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:05:11.657941 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-09e5b192-ffcd-43ed-a626-03ab4d77fb07 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] 10.222.0.43 "GET /compute/v2.1/servers/d5d97f9b-3f4a-4a5e-89e8-98d55412fe71" status: 200 len: 1723 microversion: 2.1 time: 0.660199 Jun 29 08:05:11.670308 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 116/234] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:05:10 2022] GET /compute/v2.1/servers/d5d97f9b-3f4a-4a5e-89e8-98d55412fe71 => generated 1723 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:05:12.085689 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-049372e4-90d1-4f54-a55b-8eb2f8a70c8f tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:05:12.086476 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-049372e4-90d1-4f54-a55b-8eb2f8a70c8f tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] [instance: f99567d1-cadf-40c5-b1dc-f86739b2b16c] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:05:12.123094 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-049372e4-90d1-4f54-a55b-8eb2f8a70c8f tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:05:12.124081 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-049372e4-90d1-4f54-a55b-8eb2f8a70c8f tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:05:12.125145 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-049372e4-90d1-4f54-a55b-8eb2f8a70c8f tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:05:12.126393 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-049372e4-90d1-4f54-a55b-8eb2f8a70c8f tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:05:12.678880 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-f7ed7467-0f19-438d-9513-c2b28bbfe2d2 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:05:12.679564 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-f7ed7467-0f19-438d-9513-c2b28bbfe2d2 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] [instance: d5d97f9b-3f4a-4a5e-89e8-98d55412fe71] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:05:12.705091 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-f7ed7467-0f19-438d-9513-c2b28bbfe2d2 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:05:12.705823 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-f7ed7467-0f19-438d-9513-c2b28bbfe2d2 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:05:12.709264 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-f7ed7467-0f19-438d-9513-c2b28bbfe2d2 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:05:12.709989 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-f7ed7467-0f19-438d-9513-c2b28bbfe2d2 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:05:12.870691 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-049372e4-90d1-4f54-a55b-8eb2f8a70c8f tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:05:12.887185 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-049372e4-90d1-4f54-a55b-8eb2f8a70c8f tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:05:12.898092 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-049372e4-90d1-4f54-a55b-8eb2f8a70c8f tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:05:12.901951 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-049372e4-90d1-4f54-a55b-8eb2f8a70c8f tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] 10.222.0.43 "GET /compute/v2.1/servers/f99567d1-cadf-40c5-b1dc-f86739b2b16c" status: 200 len: 1725 microversion: 2.20 time: 0.818629 Jun 29 08:05:12.903260 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 119/235] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 29 08:05:12 2022] GET /compute/v2.1/servers/f99567d1-cadf-40c5-b1dc-f86739b2b16c => generated 1725 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:05:13.156595 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-f7ed7467-0f19-438d-9513-c2b28bbfe2d2 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c70c44993ab240b1a5231df4c9d550c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e0c37d941434569b3dbd07e22125210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:05:13.172625 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-f7ed7467-0f19-438d-9513-c2b28bbfe2d2 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] 10.222.0.43 "GET /compute/v2.1/servers/d5d97f9b-3f4a-4a5e-89e8-98d55412fe71" status: 200 len: 1723 microversion: 2.1 time: 0.500002 Jun 29 08:05:13.194608 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 117/236] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:05:12 2022] GET /compute/v2.1/servers/d5d97f9b-3f4a-4a5e-89e8-98d55412fe71 => generated 1723 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 08:05:13.940305 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-e49e35c2-378d-4855-bb9f-afb6bd2a1ba6 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:05:13.943805 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-e49e35c2-378d-4855-bb9f-afb6bd2a1ba6 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] [instance: f99567d1-cadf-40c5-b1dc-f86739b2b16c] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:05:13.993671 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e49e35c2-378d-4855-bb9f-afb6bd2a1ba6 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:05:13.997996 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e49e35c2-378d-4855-bb9f-afb6bd2a1ba6 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:05:14.021389 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e49e35c2-378d-4855-bb9f-afb6bd2a1ba6 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:05:14.022324 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e49e35c2-378d-4855-bb9f-afb6bd2a1ba6 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:05:14.171534 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-e4cf805d-14ae-491b-b0d8-a4568f58246c tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-494392931", "imageRef": "5d2148a0-3628-4eff-88e9-5686abc0d33e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6d288728-176e-477c-8692-ca82d6facbbc"}], "security_groups": [{"name": "tempest-securitygroup--412796911"}], "key_name": "tempest-keypair-717086815", "user_data": "}} {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:05:14.613351 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.network.neutron [None req-e4cf805d-14ae-491b-b0d8-a4568f58246c tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] validate_networks() for [('6d288728-176e-477c-8692-ca82d6facbbc', None, None, None, None, None)] {{(pid=117890) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 29 08:05:14.890187 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-e49e35c2-378d-4855-bb9f-afb6bd2a1ba6 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:05:14.903923 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-e49e35c2-378d-4855-bb9f-afb6bd2a1ba6 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:05:14.911749 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-e49e35c2-378d-4855-bb9f-afb6bd2a1ba6 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:05:14.915840 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-e49e35c2-378d-4855-bb9f-afb6bd2a1ba6 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] 10.222.0.43 "GET /compute/v2.1/servers/f99567d1-cadf-40c5-b1dc-f86739b2b16c" status: 200 len: 1725 microversion: 2.20 time: 0.990205 Jun 29 08:05:14.917228 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 120/237] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 29 08:05:13 2022] GET /compute/v2.1/servers/f99567d1-cadf-40c5-b1dc-f86739b2b16c => generated 1725 bytes in 995 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:05:14.927225 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-b2c7f612-0dc2-4b40-8d87-62ed7b903a64 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:05:14.933329 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-b2c7f612-0dc2-4b40-8d87-62ed7b903a64 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] [instance: d5d97f9b-3f4a-4a5e-89e8-98d55412fe71] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:05:14.950929 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-b2c7f612-0dc2-4b40-8d87-62ed7b903a64 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:05:14.954458 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-b2c7f612-0dc2-4b40-8d87-62ed7b903a64 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:05:14.955619 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-b2c7f612-0dc2-4b40-8d87-62ed7b903a64 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:05:14.965921 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-b2c7f612-0dc2-4b40-8d87-62ed7b903a64 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:05:16.047851 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-b2c7f612-0dc2-4b40-8d87-62ed7b903a64 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c70c44993ab240b1a5231df4c9d550c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e0c37d941434569b3dbd07e22125210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:05:16.096691 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-b2c7f612-0dc2-4b40-8d87-62ed7b903a64 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] 10.222.0.43 "GET /compute/v2.1/servers/d5d97f9b-3f4a-4a5e-89e8-98d55412fe71" status: 200 len: 1723 microversion: 2.1 time: 1.176767 Jun 29 08:05:16.098023 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 121/238] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:05:14 2022] GET /compute/v2.1/servers/d5d97f9b-3f4a-4a5e-89e8-98d55412fe71 => generated 1723 bytes in 1179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:05:16.134114 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-0e81f3ab-1eb8-4b27-beef-75eb028980b7 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:05:16.135211 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-0e81f3ab-1eb8-4b27-beef-75eb028980b7 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] [instance: f99567d1-cadf-40c5-b1dc-f86739b2b16c] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:05:16.184353 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-0e81f3ab-1eb8-4b27-beef-75eb028980b7 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:05:16.185384 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-0e81f3ab-1eb8-4b27-beef-75eb028980b7 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:05:16.186959 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-0e81f3ab-1eb8-4b27-beef-75eb028980b7 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:05:16.187763 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-0e81f3ab-1eb8-4b27-beef-75eb028980b7 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:05:16.283575 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.virt.hardware [None req-e4cf805d-14ae-491b-b0d8-a4568f58246c tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Flavor limits 0:0:0 {{(pid=117890) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 29 08:05:16.284275 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.virt.hardware [None req-e4cf805d-14ae-491b-b0d8-a4568f58246c tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Image limits 0:0:0 {{(pid=117890) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 29 08:05:16.285332 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.virt.hardware [None req-e4cf805d-14ae-491b-b0d8-a4568f58246c tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Flavor pref 0:0:0 {{(pid=117890) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 29 08:05:16.286059 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.virt.hardware [None req-e4cf805d-14ae-491b-b0d8-a4568f58246c tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Image pref 0:0:0 {{(pid=117890) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 29 08:05:16.286811 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.virt.hardware [None req-e4cf805d-14ae-491b-b0d8-a4568f58246c tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117890) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 29 08:05:16.326929 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-e4cf805d-14ae-491b-b0d8-a4568f58246c tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:05:16.345245 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-e4cf805d-14ae-491b-b0d8-a4568f58246c tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:05:16.349437 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-e4cf805d-14ae-491b-b0d8-a4568f58246c tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:05:16.353523 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-e4cf805d-14ae-491b-b0d8-a4568f58246c tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:05:16.463471 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.quota [None req-e4cf805d-14ae-491b-b0d8-a4568f58246c tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Getting quotas for project ab693125979f4bb7b7b3c94061610fe2. Resources: {'ram', 'instances', 'cores'} {{(pid=117890) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 29 08:05:16.473398 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.quota [None req-e4cf805d-14ae-491b-b0d8-a4568f58246c tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Getting quotas for user 1f4af4eedee24897be2e702ef51873b3 and project ab693125979f4bb7b7b3c94061610fe2. Resources: {'ram', 'instances', 'cores'} {{(pid=117890) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 29 08:05:16.497962 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-e4cf805d-14ae-491b-b0d8-a4568f58246c tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Going to run 1 instances... {{(pid=117890) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 29 08:05:16.502509 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-e4cf805d-14ae-491b-b0d8-a4568f58246c tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] [instance: ca231b38-fd3e-43ba-9cba-1de10a1ffeec] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5d2148a0-3628-4eff-88e9-5686abc0d33e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117890) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 29 08:05:16.741781 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-e4cf805d-14ae-491b-b0d8-a4568f58246c tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 2.582783 Jun 29 08:05:16.753034 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 118/239] 10.222.0.43 () {60 vars in 1146 bytes} [Wed Jun 29 08:05:14 2022] POST /compute/v2.1/servers => generated 408 bytes in 2593 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 29 08:05:16.790367 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-e05c6030-f62c-4c02-8f95-24242196219d tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:05:16.791542 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-e05c6030-f62c-4c02-8f95-24242196219d tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] [instance: ca231b38-fd3e-43ba-9cba-1de10a1ffeec] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:05:17.047994 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-e05c6030-f62c-4c02-8f95-24242196219d tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4af4eedee24897be2e702ef51873b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab693125979f4bb7b7b3c94061610fe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:05:17.080400 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-e05c6030-f62c-4c02-8f95-24242196219d tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] 10.222.0.43 "GET /compute/v2.1/servers/ca231b38-fd3e-43ba-9cba-1de10a1ffeec" status: 200 len: 1244 microversion: 2.1 time: 0.314322 Jun 29 08:05:17.085435 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 119/240] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:05:16 2022] GET /compute/v2.1/servers/ca231b38-fd3e-43ba-9cba-1de10a1ffeec => generated 1244 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:05:17.127686 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-32ce83d9-bfdb-47da-9da2-0552dd7d227c tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:05:17.129131 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-32ce83d9-bfdb-47da-9da2-0552dd7d227c tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] [instance: d5d97f9b-3f4a-4a5e-89e8-98d55412fe71] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:05:17.147628 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-32ce83d9-bfdb-47da-9da2-0552dd7d227c tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:05:17.149129 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-32ce83d9-bfdb-47da-9da2-0552dd7d227c tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:05:17.156603 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-32ce83d9-bfdb-47da-9da2-0552dd7d227c tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:05:17.158229 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-32ce83d9-bfdb-47da-9da2-0552dd7d227c tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:05:17.641441 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-0e81f3ab-1eb8-4b27-beef-75eb028980b7 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:05:17.750413 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-0e81f3ab-1eb8-4b27-beef-75eb028980b7 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:05:17.763608 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-0e81f3ab-1eb8-4b27-beef-75eb028980b7 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:05:17.778937 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-0e81f3ab-1eb8-4b27-beef-75eb028980b7 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] 10.222.0.43 "GET /compute/v2.1/servers/f99567d1-cadf-40c5-b1dc-f86739b2b16c" status: 200 len: 1746 microversion: 2.20 time: 1.679181 Jun 29 08:05:17.845205 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 122/241] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 29 08:05:16 2022] GET /compute/v2.1/servers/f99567d1-cadf-40c5-b1dc-f86739b2b16c => generated 1746 bytes in 1747 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:05:18.125629 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-c48ff7a9-573e-4086-bb5d-c8d33b4e42d6 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:05:18.126774 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-c48ff7a9-573e-4086-bb5d-c8d33b4e42d6 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] [instance: ca231b38-fd3e-43ba-9cba-1de10a1ffeec] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:05:18.584271 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-c48ff7a9-573e-4086-bb5d-c8d33b4e42d6 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4af4eedee24897be2e702ef51873b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab693125979f4bb7b7b3c94061610fe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:05:18.609035 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-c48ff7a9-573e-4086-bb5d-c8d33b4e42d6 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] 10.222.0.43 "GET /compute/v2.1/servers/ca231b38-fd3e-43ba-9cba-1de10a1ffeec" status: 200 len: 1244 microversion: 2.1 time: 0.500705 Jun 29 08:05:18.613396 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 123/242] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:05:18 2022] GET /compute/v2.1/servers/ca231b38-fd3e-43ba-9cba-1de10a1ffeec => generated 1244 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:05:18.637280 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-32ce83d9-bfdb-47da-9da2-0552dd7d227c tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c70c44993ab240b1a5231df4c9d550c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e0c37d941434569b3dbd07e22125210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:05:18.648815 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-32ce83d9-bfdb-47da-9da2-0552dd7d227c tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] 10.222.0.43 "GET /compute/v2.1/servers/d5d97f9b-3f4a-4a5e-89e8-98d55412fe71" status: 200 len: 1723 microversion: 2.1 time: 1.528708 Jun 29 08:05:18.662712 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 120/243] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:05:17 2022] GET /compute/v2.1/servers/d5d97f9b-3f4a-4a5e-89e8-98d55412fe71 => generated 1723 bytes in 1543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:05:18.916051 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-16fa606c-b97e-4cf9-b090-dbc87ca08d74 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:05:18.919899 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-16fa606c-b97e-4cf9-b090-dbc87ca08d74 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] [instance: f99567d1-cadf-40c5-b1dc-f86739b2b16c] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:05:18.965997 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-16fa606c-b97e-4cf9-b090-dbc87ca08d74 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:05:18.975201 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-16fa606c-b97e-4cf9-b090-dbc87ca08d74 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:05:18.978745 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-16fa606c-b97e-4cf9-b090-dbc87ca08d74 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:05:18.982968 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-16fa606c-b97e-4cf9-b090-dbc87ca08d74 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:05:19.633804 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-c535d19e-40f4-430c-a0a8-be5295fcef0a tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:05:19.639107 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-c535d19e-40f4-430c-a0a8-be5295fcef0a tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] [instance: ca231b38-fd3e-43ba-9cba-1de10a1ffeec] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:05:19.671117 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-c535d19e-40f4-430c-a0a8-be5295fcef0a tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:05:19.674718 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-c535d19e-40f4-430c-a0a8-be5295fcef0a tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:05:19.683092 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-c535d19e-40f4-430c-a0a8-be5295fcef0a tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:05:19.700882 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-c535d19e-40f4-430c-a0a8-be5295fcef0a tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:05:20.021242 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-c535d19e-40f4-430c-a0a8-be5295fcef0a tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4af4eedee24897be2e702ef51873b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab693125979f4bb7b7b3c94061610fe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:05:20.076268 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-c535d19e-40f4-430c-a0a8-be5295fcef0a tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] 10.222.0.43 "GET /compute/v2.1/servers/ca231b38-fd3e-43ba-9cba-1de10a1ffeec" status: 200 len: 1240 microversion: 2.1 time: 0.437371 Jun 29 08:05:20.091591 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 121/244] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:05:19 2022] GET /compute/v2.1/servers/ca231b38-fd3e-43ba-9cba-1de10a1ffeec => generated 1240 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:05:20.110409 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-a422e7ae-09c4-4877-91b3-27fa4f822db7 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:05:20.111793 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-a422e7ae-09c4-4877-91b3-27fa4f822db7 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] [instance: d5d97f9b-3f4a-4a5e-89e8-98d55412fe71] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:05:20.138974 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-a422e7ae-09c4-4877-91b3-27fa4f822db7 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:05:20.143198 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-a422e7ae-09c4-4877-91b3-27fa4f822db7 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:05:20.148038 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-a422e7ae-09c4-4877-91b3-27fa4f822db7 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:05:20.148769 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-a422e7ae-09c4-4877-91b3-27fa4f822db7 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:05:20.184474 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-16fa606c-b97e-4cf9-b090-dbc87ca08d74 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:05:20.200200 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-16fa606c-b97e-4cf9-b090-dbc87ca08d74 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:05:20.204710 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-16fa606c-b97e-4cf9-b090-dbc87ca08d74 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:05:20.209612 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-16fa606c-b97e-4cf9-b090-dbc87ca08d74 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] 10.222.0.43 "GET /compute/v2.1/servers/f99567d1-cadf-40c5-b1dc-f86739b2b16c" status: 200 len: 1746 microversion: 2.20 time: 1.338736 Jun 29 08:05:20.214251 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 124/245] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 29 08:05:18 2022] GET /compute/v2.1/servers/f99567d1-cadf-40c5-b1dc-f86739b2b16c => generated 1746 bytes in 1347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:05:20.758427 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-a422e7ae-09c4-4877-91b3-27fa4f822db7 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c70c44993ab240b1a5231df4c9d550c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e0c37d941434569b3dbd07e22125210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:05:20.770006 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-a422e7ae-09c4-4877-91b3-27fa4f822db7 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] 10.222.0.43 "GET /compute/v2.1/servers/d5d97f9b-3f4a-4a5e-89e8-98d55412fe71" status: 200 len: 1723 microversion: 2.1 time: 0.685316 Jun 29 08:05:20.772710 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 122/246] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:05:20 2022] GET /compute/v2.1/servers/d5d97f9b-3f4a-4a5e-89e8-98d55412fe71 => generated 1723 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:05:21.104191 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-95fe66ca-7b33-4ecf-a5fb-0aa45e6da165 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:05:21.112593 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-95fe66ca-7b33-4ecf-a5fb-0aa45e6da165 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] [instance: ca231b38-fd3e-43ba-9cba-1de10a1ffeec] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:05:21.173241 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-95fe66ca-7b33-4ecf-a5fb-0aa45e6da165 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:05:21.174603 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-95fe66ca-7b33-4ecf-a5fb-0aa45e6da165 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:05:21.183205 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-95fe66ca-7b33-4ecf-a5fb-0aa45e6da165 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:05:21.185333 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-95fe66ca-7b33-4ecf-a5fb-0aa45e6da165 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:05:21.245407 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-b035704b-ad2b-4357-a7ed-69b80a643c61 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:05:21.246797 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-b035704b-ad2b-4357-a7ed-69b80a643c61 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] [instance: f99567d1-cadf-40c5-b1dc-f86739b2b16c] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:05:21.287180 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-b035704b-ad2b-4357-a7ed-69b80a643c61 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:05:21.287769 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-b035704b-ad2b-4357-a7ed-69b80a643c61 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:05:21.301986 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-b035704b-ad2b-4357-a7ed-69b80a643c61 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:05:21.305196 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-b035704b-ad2b-4357-a7ed-69b80a643c61 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:05:21.542778 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-95fe66ca-7b33-4ecf-a5fb-0aa45e6da165 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4af4eedee24897be2e702ef51873b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab693125979f4bb7b7b3c94061610fe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:05:21.565667 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-95fe66ca-7b33-4ecf-a5fb-0aa45e6da165 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] 10.222.0.43 "GET /compute/v2.1/servers/ca231b38-fd3e-43ba-9cba-1de10a1ffeec" status: 200 len: 1302 microversion: 2.1 time: 0.458521 Jun 29 08:05:21.569807 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 125/247] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:05:21 2022] GET /compute/v2.1/servers/ca231b38-fd3e-43ba-9cba-1de10a1ffeec => generated 1302 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:05:21.792048 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-bfc0072f-6534-49aa-880a-92e285ee27ac tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:05:21.792808 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-bfc0072f-6534-49aa-880a-92e285ee27ac tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] [instance: d5d97f9b-3f4a-4a5e-89e8-98d55412fe71] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:05:21.821113 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-bfc0072f-6534-49aa-880a-92e285ee27ac tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:05:21.821662 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-bfc0072f-6534-49aa-880a-92e285ee27ac tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:05:21.822540 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-bfc0072f-6534-49aa-880a-92e285ee27ac tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:05:21.827414 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-bfc0072f-6534-49aa-880a-92e285ee27ac tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:05:21.928589 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-b035704b-ad2b-4357-a7ed-69b80a643c61 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:05:21.958534 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-b035704b-ad2b-4357-a7ed-69b80a643c61 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:05:21.974393 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-b035704b-ad2b-4357-a7ed-69b80a643c61 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:05:21.993342 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-b035704b-ad2b-4357-a7ed-69b80a643c61 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] 10.222.0.43 "GET /compute/v2.1/servers/f99567d1-cadf-40c5-b1dc-f86739b2b16c" status: 200 len: 1741 microversion: 2.20 time: 0.743591 Jun 29 08:05:21.993342 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 123/248] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 29 08:05:21 2022] GET /compute/v2.1/servers/f99567d1-cadf-40c5-b1dc-f86739b2b16c => generated 1741 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:05:22.009770 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-fc3895f1-9e98-4431-9de0-18beb13cd56f tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9655d8dc-cf59-424b-93bd-f866886b00b1", "device": "/dev/sdb"}} {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:05:22.019859 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-fc3895f1-9e98-4431-9de0-18beb13cd56f tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] [instance: 2e99307a-e437-4e8d-821c-319cc555e209] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:05:22.056458 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-fc3895f1-9e98-4431-9de0-18beb13cd56f tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:05:22.057145 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-fc3895f1-9e98-4431-9de0-18beb13cd56f tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:05:22.058369 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-fc3895f1-9e98-4431-9de0-18beb13cd56f tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:05:22.059004 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-fc3895f1-9e98-4431-9de0-18beb13cd56f tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:05:23.123448 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-fc3895f1-9e98-4431-9de0-18beb13cd56f tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] 10.222.0.43 "POST /compute/v2.1/servers/2e99307a-e437-4e8d-821c-319cc555e209/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.120814 Jun 29 08:05:23.139305 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 124/249] 10.222.0.43 () {60 vars in 1322 bytes} [Wed Jun 29 08:05:22 2022] POST /compute/v2.1/servers/2e99307a-e437-4e8d-821c-319cc555e209/os-volume_attachments => generated 194 bytes in 1138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:05:23.207483 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-91b8afae-0fee-4ffd-854a-c9c3265305f7 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:05:23.209896 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-91b8afae-0fee-4ffd-854a-c9c3265305f7 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] [instance: ca231b38-fd3e-43ba-9cba-1de10a1ffeec] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:05:23.227954 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-91b8afae-0fee-4ffd-854a-c9c3265305f7 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:05:23.229128 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-91b8afae-0fee-4ffd-854a-c9c3265305f7 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:05:23.230670 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-91b8afae-0fee-4ffd-854a-c9c3265305f7 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:05:23.232633 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-91b8afae-0fee-4ffd-854a-c9c3265305f7 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:05:23.333318 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-bfc0072f-6534-49aa-880a-92e285ee27ac tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c70c44993ab240b1a5231df4c9d550c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e0c37d941434569b3dbd07e22125210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:05:23.403247 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-bfc0072f-6534-49aa-880a-92e285ee27ac tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] 10.222.0.43 "GET /compute/v2.1/servers/d5d97f9b-3f4a-4a5e-89e8-98d55412fe71" status: 200 len: 1700 microversion: 2.1 time: 1.615394 Jun 29 08:05:23.429086 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 126/250] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:05:21 2022] GET /compute/v2.1/servers/d5d97f9b-3f4a-4a5e-89e8-98d55412fe71 => generated 1700 bytes in 1642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:05:23.451352 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-f4ada0e3-b80e-46dc-b955-337aaab2d54d tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:05:23.457276 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-f4ada0e3-b80e-46dc-b955-337aaab2d54d tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] [instance: f99567d1-cadf-40c5-b1dc-f86739b2b16c] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:05:23.474621 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-91b8afae-0fee-4ffd-854a-c9c3265305f7 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4af4eedee24897be2e702ef51873b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab693125979f4bb7b7b3c94061610fe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:05:23.511403 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-f4ada0e3-b80e-46dc-b955-337aaab2d54d tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:05:23.516618 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-f4ada0e3-b80e-46dc-b955-337aaab2d54d tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:05:23.518492 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-f4ada0e3-b80e-46dc-b955-337aaab2d54d tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:05:23.520733 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-f4ada0e3-b80e-46dc-b955-337aaab2d54d tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:05:23.530110 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-91b8afae-0fee-4ffd-854a-c9c3265305f7 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] 10.222.0.43 "GET /compute/v2.1/servers/ca231b38-fd3e-43ba-9cba-1de10a1ffeec" status: 200 len: 1302 microversion: 2.1 time: 0.348679 Jun 29 08:05:23.533768 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 125/251] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:05:23 2022] GET /compute/v2.1/servers/ca231b38-fd3e-43ba-9cba-1de10a1ffeec => generated 1302 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:05:23.557852 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-d30b3ae3-29e7-43db-b9d7-3f3e2cd98305 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:05:23.578717 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-d30b3ae3-29e7-43db-b9d7-3f3e2cd98305 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:05:23.584115 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-d30b3ae3-29e7-43db-b9d7-3f3e2cd98305 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:05:23.799487 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-d30b3ae3-29e7-43db-b9d7-3f3e2cd98305 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] [instance: d5d97f9b-3f4a-4a5e-89e8-98d55412fe71] Going to try to start instance {{(pid=117890) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 29 08:05:23.902814 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-d30b3ae3-29e7-43db-b9d7-3f3e2cd98305 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] 10.222.0.43 "POST /compute/v2.1/servers/d5d97f9b-3f4a-4a5e-89e8-98d55412fe71/action" status: 202 len: 0 microversion: 2.1 time: 0.366916 Jun 29 08:05:23.914900 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 126/252] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Jun 29 08:05:23 2022] POST /compute/v2.1/servers/d5d97f9b-3f4a-4a5e-89e8-98d55412fe71/action => generated 0 bytes in 375 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 29 08:05:23.931442 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-2e3ca495-c563-45fc-8f04-04faa37ff07f tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:05:23.932943 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-2e3ca495-c563-45fc-8f04-04faa37ff07f tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] [instance: d5d97f9b-3f4a-4a5e-89e8-98d55412fe71] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:05:23.951975 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-2e3ca495-c563-45fc-8f04-04faa37ff07f tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:05:23.955535 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-2e3ca495-c563-45fc-8f04-04faa37ff07f tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:05:23.961697 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-2e3ca495-c563-45fc-8f04-04faa37ff07f tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:05:23.965896 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-2e3ca495-c563-45fc-8f04-04faa37ff07f tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:05:24.539967 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-f4ada0e3-b80e-46dc-b955-337aaab2d54d tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:05:24.577582 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-f4ada0e3-b80e-46dc-b955-337aaab2d54d tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:05:24.594443 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-f4ada0e3-b80e-46dc-b955-337aaab2d54d tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:05:24.603088 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-f4ada0e3-b80e-46dc-b955-337aaab2d54d tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] 10.222.0.43 "GET /compute/v2.1/servers/f99567d1-cadf-40c5-b1dc-f86739b2b16c" status: 200 len: 1741 microversion: 2.20 time: 1.166301 Jun 29 08:05:24.605347 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 127/253] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 29 08:05:23 2022] GET /compute/v2.1/servers/f99567d1-cadf-40c5-b1dc-f86739b2b16c => generated 1741 bytes in 1176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:05:24.651565 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-19a2d447-8a3d-42aa-9908-b5721b2381ab tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:05:24.653417 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-19a2d447-8a3d-42aa-9908-b5721b2381ab tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] [instance: ca231b38-fd3e-43ba-9cba-1de10a1ffeec] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:05:24.671971 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-19a2d447-8a3d-42aa-9908-b5721b2381ab tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:05:24.672851 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-19a2d447-8a3d-42aa-9908-b5721b2381ab tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:05:24.674197 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-19a2d447-8a3d-42aa-9908-b5721b2381ab tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:05:24.676011 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-19a2d447-8a3d-42aa-9908-b5721b2381ab tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:05:24.898037 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-2e3ca495-c563-45fc-8f04-04faa37ff07f tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c70c44993ab240b1a5231df4c9d550c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e0c37d941434569b3dbd07e22125210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:05:24.935076 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-2e3ca495-c563-45fc-8f04-04faa37ff07f tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] 10.222.0.43 "GET /compute/v2.1/servers/d5d97f9b-3f4a-4a5e-89e8-98d55412fe71" status: 200 len: 1709 microversion: 2.1 time: 1.018443 Jun 29 08:05:24.947284 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 127/254] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:05:23 2022] GET /compute/v2.1/servers/d5d97f9b-3f4a-4a5e-89e8-98d55412fe71 => generated 1709 bytes in 1030 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:05:24.965056 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [req-548e95d2-c6b6-4a8d-b32a-b6296f259218 req-5e742181-45df-406d-a632-845547793096 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f99567d1-cadf-40c5-b1dc-f86739b2b16c", "name": "network-vif-plugged", "status": "completed", "tag": "dfb8e71b-41e2-4d03-8de7-4f7323f5b53b"}]} {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:05:24.984041 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG dbcounter [-] [117890] Writing DB stats nova_api:SELECT=72,nova_api:INSERT=4 {{(pid=117890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:05:25.010251 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [req-548e95d2-c6b6-4a8d-b32a-b6296f259218 req-5e742181-45df-406d-a632-845547793096 service nova] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:05:25.010938 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [req-548e95d2-c6b6-4a8d-b32a-b6296f259218 req-5e742181-45df-406d-a632-845547793096 service nova] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:05:25.055139 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.compute.server_external_events [req-548e95d2-c6b6-4a8d-b32a-b6296f259218 req-5e742181-45df-406d-a632-845547793096 service nova] Creating event network-vif-plugged:dfb8e71b-41e2-4d03-8de7-4f7323f5b53b for instance f99567d1-cadf-40c5-b1dc-f86739b2b16c on hv-cinder-76810 Jun 29 08:05:25.071197 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-19a2d447-8a3d-42aa-9908-b5721b2381ab tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4af4eedee24897be2e702ef51873b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab693125979f4bb7b7b3c94061610fe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:05:25.090998 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [req-548e95d2-c6b6-4a8d-b32a-b6296f259218 req-5e742181-45df-406d-a632-845547793096 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.141637 Jun 29 08:05:25.096253 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-19a2d447-8a3d-42aa-9908-b5721b2381ab tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] 10.222.0.43 "GET /compute/v2.1/servers/ca231b38-fd3e-43ba-9cba-1de10a1ffeec" status: 200 len: 1302 microversion: 2.1 time: 0.455794 Jun 29 08:05:25.097229 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 128/255] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:05:24 2022] GET /compute/v2.1/servers/ca231b38-fd3e-43ba-9cba-1de10a1ffeec => generated 1302 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:05:25.102439 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 128/256] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jun 29 08:05:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:05:25.658332 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-ed9f30a9-74b6-4b5e-83c3-dab425146c51 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:05:25.660035 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-ed9f30a9-74b6-4b5e-83c3-dab425146c51 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] [instance: f99567d1-cadf-40c5-b1dc-f86739b2b16c] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:05:25.692019 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ed9f30a9-74b6-4b5e-83c3-dab425146c51 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:05:25.693234 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ed9f30a9-74b6-4b5e-83c3-dab425146c51 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:05:25.694664 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ed9f30a9-74b6-4b5e-83c3-dab425146c51 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:05:25.695461 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ed9f30a9-74b6-4b5e-83c3-dab425146c51 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:05:25.971433 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-b22e8d49-ecb6-4263-a15f-67608b05b519 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:05:25.977662 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-b22e8d49-ecb6-4263-a15f-67608b05b519 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] [instance: d5d97f9b-3f4a-4a5e-89e8-98d55412fe71] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:05:26.004421 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-b22e8d49-ecb6-4263-a15f-67608b05b519 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:05:26.013346 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-b22e8d49-ecb6-4263-a15f-67608b05b519 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:05:26.015164 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-b22e8d49-ecb6-4263-a15f-67608b05b519 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:05:26.015811 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-b22e8d49-ecb6-4263-a15f-67608b05b519 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:05:26.017420 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-ed9f30a9-74b6-4b5e-83c3-dab425146c51 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:05:26.054776 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-ed9f30a9-74b6-4b5e-83c3-dab425146c51 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:05:26.059410 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-ed9f30a9-74b6-4b5e-83c3-dab425146c51 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:05:26.070153 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-ed9f30a9-74b6-4b5e-83c3-dab425146c51 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] 10.222.0.43 "GET /compute/v2.1/servers/f99567d1-cadf-40c5-b1dc-f86739b2b16c" status: 200 len: 1741 microversion: 2.20 time: 0.429807 Jun 29 08:05:26.076826 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 129/257] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 29 08:05:25 2022] GET /compute/v2.1/servers/f99567d1-cadf-40c5-b1dc-f86739b2b16c => generated 1741 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:05:26.135229 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-4d11487f-c193-4b9e-a3c1-fe2cd648d2ee tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:05:26.138554 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-4d11487f-c193-4b9e-a3c1-fe2cd648d2ee tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] [instance: ca231b38-fd3e-43ba-9cba-1de10a1ffeec] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:05:26.156396 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-4d11487f-c193-4b9e-a3c1-fe2cd648d2ee tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:05:26.157825 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-4d11487f-c193-4b9e-a3c1-fe2cd648d2ee tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:05:26.161450 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-4d11487f-c193-4b9e-a3c1-fe2cd648d2ee tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:05:26.162592 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-4d11487f-c193-4b9e-a3c1-fe2cd648d2ee tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:05:26.439710 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG dbcounter [-] [117890] Writing DB stats nova_cell0:SELECT=2 {{(pid=117890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:05:26.459388 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-b22e8d49-ecb6-4263-a15f-67608b05b519 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c70c44993ab240b1a5231df4c9d550c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e0c37d941434569b3dbd07e22125210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:05:26.472817 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-b22e8d49-ecb6-4263-a15f-67608b05b519 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] 10.222.0.43 "GET /compute/v2.1/servers/d5d97f9b-3f4a-4a5e-89e8-98d55412fe71" status: 200 len: 1709 microversion: 2.1 time: 0.506356 Jun 29 08:05:26.473826 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 129/258] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:05:25 2022] GET /compute/v2.1/servers/d5d97f9b-3f4a-4a5e-89e8-98d55412fe71 => generated 1709 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:05:26.589616 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-4d11487f-c193-4b9e-a3c1-fe2cd648d2ee tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4af4eedee24897be2e702ef51873b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab693125979f4bb7b7b3c94061610fe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:05:26.608213 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-4d11487f-c193-4b9e-a3c1-fe2cd648d2ee tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] 10.222.0.43 "GET /compute/v2.1/servers/ca231b38-fd3e-43ba-9cba-1de10a1ffeec" status: 200 len: 1369 microversion: 2.1 time: 0.485930 Jun 29 08:05:26.610248 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 130/259] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:05:26 2022] GET /compute/v2.1/servers/ca231b38-fd3e-43ba-9cba-1de10a1ffeec => generated 1369 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 08:05:27.098392 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-b03aa6e1-e8ab-4f90-926e-a01ad06ec181 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:05:27.099245 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-b03aa6e1-e8ab-4f90-926e-a01ad06ec181 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] [instance: f99567d1-cadf-40c5-b1dc-f86739b2b16c] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:05:27.102401 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG dbcounter [-] [117890] Writing DB stats nova_cell0:SELECT=12 {{(pid=117890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:05:27.110040 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-b03aa6e1-e8ab-4f90-926e-a01ad06ec181 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:05:27.110848 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-b03aa6e1-e8ab-4f90-926e-a01ad06ec181 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:05:27.112092 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-b03aa6e1-e8ab-4f90-926e-a01ad06ec181 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:05:27.113859 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-b03aa6e1-e8ab-4f90-926e-a01ad06ec181 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:05:27.379432 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-b03aa6e1-e8ab-4f90-926e-a01ad06ec181 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:05:27.390088 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-b03aa6e1-e8ab-4f90-926e-a01ad06ec181 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:05:27.395697 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-b03aa6e1-e8ab-4f90-926e-a01ad06ec181 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:05:27.399205 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-b03aa6e1-e8ab-4f90-926e-a01ad06ec181 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] 10.222.0.43 "GET /compute/v2.1/servers/f99567d1-cadf-40c5-b1dc-f86739b2b16c" status: 200 len: 1741 microversion: 2.20 time: 0.309323 Jun 29 08:05:27.401472 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 130/260] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 29 08:05:27 2022] GET /compute/v2.1/servers/f99567d1-cadf-40c5-b1dc-f86739b2b16c => generated 1741 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:05:27.511106 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-703dfb4e-9f0f-4463-a68a-e26d64b517dd tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:05:27.512101 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-703dfb4e-9f0f-4463-a68a-e26d64b517dd tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] [instance: d5d97f9b-3f4a-4a5e-89e8-98d55412fe71] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:05:27.524436 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-703dfb4e-9f0f-4463-a68a-e26d64b517dd tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:05:27.526099 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-703dfb4e-9f0f-4463-a68a-e26d64b517dd tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:05:27.527676 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-703dfb4e-9f0f-4463-a68a-e26d64b517dd tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:05:27.528572 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-703dfb4e-9f0f-4463-a68a-e26d64b517dd tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:05:27.537369 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:05:27.651081 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-fdf3dfba-2e8e-4f46-8543-609b249c9641 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:05:27.652155 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-fdf3dfba-2e8e-4f46-8543-609b249c9641 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] [instance: ca231b38-fd3e-43ba-9cba-1de10a1ffeec] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:05:27.684325 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-fdf3dfba-2e8e-4f46-8543-609b249c9641 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:05:27.685469 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-fdf3dfba-2e8e-4f46-8543-609b249c9641 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:05:27.695959 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-fdf3dfba-2e8e-4f46-8543-609b249c9641 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:05:27.696141 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-fdf3dfba-2e8e-4f46-8543-609b249c9641 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:05:27.972576 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-703dfb4e-9f0f-4463-a68a-e26d64b517dd tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c70c44993ab240b1a5231df4c9d550c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e0c37d941434569b3dbd07e22125210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:05:28.010506 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-703dfb4e-9f0f-4463-a68a-e26d64b517dd tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] 10.222.0.43 "GET /compute/v2.1/servers/d5d97f9b-3f4a-4a5e-89e8-98d55412fe71" status: 200 len: 1709 microversion: 2.1 time: 0.521014 Jun 29 08:05:28.011776 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 131/261] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:05:27 2022] GET /compute/v2.1/servers/d5d97f9b-3f4a-4a5e-89e8-98d55412fe71 => generated 1709 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:05:28.066974 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-fdf3dfba-2e8e-4f46-8543-609b249c9641 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4af4eedee24897be2e702ef51873b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab693125979f4bb7b7b3c94061610fe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:05:28.078067 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-fdf3dfba-2e8e-4f46-8543-609b249c9641 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] 10.222.0.43 "GET /compute/v2.1/servers/ca231b38-fd3e-43ba-9cba-1de10a1ffeec" status: 200 len: 1369 microversion: 2.1 time: 0.443154 Jun 29 08:05:28.081595 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 131/262] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:05:27 2022] GET /compute/v2.1/servers/ca231b38-fd3e-43ba-9cba-1de10a1ffeec => generated 1369 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:05:28.433975 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-44c562c3-e7eb-4b8e-a47d-15c9c5e8fef8 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:05:28.435381 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-44c562c3-e7eb-4b8e-a47d-15c9c5e8fef8 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] [instance: f99567d1-cadf-40c5-b1dc-f86739b2b16c] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:05:28.444810 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-44c562c3-e7eb-4b8e-a47d-15c9c5e8fef8 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:05:28.445591 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-44c562c3-e7eb-4b8e-a47d-15c9c5e8fef8 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:05:28.446575 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-44c562c3-e7eb-4b8e-a47d-15c9c5e8fef8 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:05:28.447174 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-44c562c3-e7eb-4b8e-a47d-15c9c5e8fef8 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:05:28.591608 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_cell0:SELECT=2 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:05:28.911068 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-44c562c3-e7eb-4b8e-a47d-15c9c5e8fef8 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:05:28.942593 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-44c562c3-e7eb-4b8e-a47d-15c9c5e8fef8 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:05:28.958646 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-44c562c3-e7eb-4b8e-a47d-15c9c5e8fef8 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:05:28.961913 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-44c562c3-e7eb-4b8e-a47d-15c9c5e8fef8 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] 10.222.0.43 "GET /compute/v2.1/servers/f99567d1-cadf-40c5-b1dc-f86739b2b16c" status: 200 len: 1741 microversion: 2.20 time: 0.533161 Jun 29 08:05:28.966421 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 132/263] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 29 08:05:28 2022] GET /compute/v2.1/servers/f99567d1-cadf-40c5-b1dc-f86739b2b16c => generated 1741 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:05:29.038309 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-14a1b229-aa11-42e9-bd30-26b70cc985fd tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:05:29.039847 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-14a1b229-aa11-42e9-bd30-26b70cc985fd tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] [instance: d5d97f9b-3f4a-4a5e-89e8-98d55412fe71] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:05:29.049919 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-14a1b229-aa11-42e9-bd30-26b70cc985fd tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:05:29.051083 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-14a1b229-aa11-42e9-bd30-26b70cc985fd tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:05:29.058887 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-14a1b229-aa11-42e9-bd30-26b70cc985fd tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:05:29.059652 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-14a1b229-aa11-42e9-bd30-26b70cc985fd tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:05:29.063446 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG dbcounter [-] [117890] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:05:29.099771 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-6a5be2ab-5ffd-442c-a8c1-ba0b20e2ef89 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:05:29.102584 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-6a5be2ab-5ffd-442c-a8c1-ba0b20e2ef89 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] [instance: ca231b38-fd3e-43ba-9cba-1de10a1ffeec] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:05:29.140272 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-6a5be2ab-5ffd-442c-a8c1-ba0b20e2ef89 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:05:29.140721 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-6a5be2ab-5ffd-442c-a8c1-ba0b20e2ef89 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:05:29.141596 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-6a5be2ab-5ffd-442c-a8c1-ba0b20e2ef89 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:05:29.141987 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-6a5be2ab-5ffd-442c-a8c1-ba0b20e2ef89 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:05:30.101451 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-14a1b229-aa11-42e9-bd30-26b70cc985fd tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c70c44993ab240b1a5231df4c9d550c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e0c37d941434569b3dbd07e22125210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:05:30.126966 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-14a1b229-aa11-42e9-bd30-26b70cc985fd tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] 10.222.0.43 "GET /compute/v2.1/servers/d5d97f9b-3f4a-4a5e-89e8-98d55412fe71" status: 200 len: 1709 microversion: 2.1 time: 1.093726 Jun 29 08:05:30.129019 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 132/264] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:05:29 2022] GET /compute/v2.1/servers/d5d97f9b-3f4a-4a5e-89e8-98d55412fe71 => generated 1709 bytes in 1097 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:05:30.147137 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-ebe6c243-c323-405f-8f9c-10da73ceb228 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:05:30.148473 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-ebe6c243-c323-405f-8f9c-10da73ceb228 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] [instance: f99567d1-cadf-40c5-b1dc-f86739b2b16c] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:05:30.162648 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-ebe6c243-c323-405f-8f9c-10da73ceb228 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:05:30.164931 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-ebe6c243-c323-405f-8f9c-10da73ceb228 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:05:30.167834 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-ebe6c243-c323-405f-8f9c-10da73ceb228 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:05:30.170062 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-ebe6c243-c323-405f-8f9c-10da73ceb228 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:05:30.843119 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-6a5be2ab-5ffd-442c-a8c1-ba0b20e2ef89 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4af4eedee24897be2e702ef51873b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab693125979f4bb7b7b3c94061610fe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:05:30.857484 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-6a5be2ab-5ffd-442c-a8c1-ba0b20e2ef89 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] 10.222.0.43 "GET /compute/v2.1/servers/ca231b38-fd3e-43ba-9cba-1de10a1ffeec" status: 200 len: 1369 microversion: 2.1 time: 1.762752 Jun 29 08:05:30.861138 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 133/265] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:05:29 2022] GET /compute/v2.1/servers/ca231b38-fd3e-43ba-9cba-1de10a1ffeec => generated 1369 bytes in 1767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 08:05:31.152641 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-3e463155-3c58-4a4d-adb6-397c4dd7f007 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:05:31.153591 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-3e463155-3c58-4a4d-adb6-397c4dd7f007 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] [instance: d5d97f9b-3f4a-4a5e-89e8-98d55412fe71] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:05:31.156454 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_api:SELECT=44 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:05:31.176348 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-3e463155-3c58-4a4d-adb6-397c4dd7f007 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:05:31.177171 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-3e463155-3c58-4a4d-adb6-397c4dd7f007 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:05:31.178612 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-3e463155-3c58-4a4d-adb6-397c4dd7f007 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:05:31.179271 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-3e463155-3c58-4a4d-adb6-397c4dd7f007 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:05:31.719710 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-ebe6c243-c323-405f-8f9c-10da73ceb228 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:05:31.757816 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-ebe6c243-c323-405f-8f9c-10da73ceb228 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:05:31.790630 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-ebe6c243-c323-405f-8f9c-10da73ceb228 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:05:31.793953 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-ebe6c243-c323-405f-8f9c-10da73ceb228 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] 10.222.0.43 "GET /compute/v2.1/servers/f99567d1-cadf-40c5-b1dc-f86739b2b16c" status: 200 len: 1741 microversion: 2.20 time: 1.662899 Jun 29 08:05:31.810030 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 133/266] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 29 08:05:30 2022] GET /compute/v2.1/servers/f99567d1-cadf-40c5-b1dc-f86739b2b16c => generated 1741 bytes in 1680 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:05:32.312305 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-3e463155-3c58-4a4d-adb6-397c4dd7f007 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c70c44993ab240b1a5231df4c9d550c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e0c37d941434569b3dbd07e22125210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:05:32.328784 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-3e463155-3c58-4a4d-adb6-397c4dd7f007 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] 10.222.0.43 "GET /compute/v2.1/servers/d5d97f9b-3f4a-4a5e-89e8-98d55412fe71" status: 200 len: 1709 microversion: 2.1 time: 1.179997 Jun 29 08:05:32.341590 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 134/267] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:05:31 2022] GET /compute/v2.1/servers/d5d97f9b-3f4a-4a5e-89e8-98d55412fe71 => generated 1709 bytes in 1193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 08:05:32.347691 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-dde3bb5e-831e-45ea-bd97-a3f59f725b7e tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:05:32.348723 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-dde3bb5e-831e-45ea-bd97-a3f59f725b7e tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] [instance: ca231b38-fd3e-43ba-9cba-1de10a1ffeec] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:05:32.411383 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-dde3bb5e-831e-45ea-bd97-a3f59f725b7e tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:05:32.418013 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-dde3bb5e-831e-45ea-bd97-a3f59f725b7e tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:05:32.418013 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-dde3bb5e-831e-45ea-bd97-a3f59f725b7e tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:05:32.418013 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-dde3bb5e-831e-45ea-bd97-a3f59f725b7e tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:05:32.685411 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-8442e3b0-c17e-4f6d-a3b8-5b073276048c tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Action: 'create', calling method: .version_select at 0x7f7241719f70>, body: {"keypair": {"name": "tempest-TestShelveInstance-915127236", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHq6jIy6kA5qjVv2ZNwn4AAZxf8liIKbtp56cKRJRLzOnAyppkywHQpLyMN+Lycc4kkDc1gVdmAJ0YELMk/9o86rEUI+BTcVrpqeDtFhYOvHjxcIbtu9NSMGcSy+FWp97Q=="}} {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:05:32.729994 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.quota [None req-8442e3b0-c17e-4f6d-a3b8-5b073276048c tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Getting quotas for project 26a20f6f9f254aae91c952ee44a4ff74. Resources: {'key_pairs'} {{(pid=117890) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 29 08:05:32.745760 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.quota [None req-8442e3b0-c17e-4f6d-a3b8-5b073276048c tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Getting quotas for user de6636a0522642799e43a8f02ee602ea and project 26a20f6f9f254aae91c952ee44a4ff74. Resources: {'key_pairs'} {{(pid=117890) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 29 08:05:32.840533 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-8442e3b0-c17e-4f6d-a3b8-5b073276048c tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 1.028254 Jun 29 08:05:32.842595 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 134/268] 10.222.0.43 () {60 vars in 1158 bytes} [Wed Jun 29 08:05:31 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 1031 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:05:32.848873 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [req-35c7bc7f-139f-47ef-af99-30aeaa15666b req-9c1d28d3-666e-4a0d-801b-e4138333330d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ca231b38-fd3e-43ba-9cba-1de10a1ffeec", "tag": "5a5ce414-6f70-43b5-a7cc-7340f679070a"}]} {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:05:32.862931 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [req-35c7bc7f-139f-47ef-af99-30aeaa15666b req-9c1d28d3-666e-4a0d-801b-e4138333330d service nova] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:05:32.863604 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [req-35c7bc7f-139f-47ef-af99-30aeaa15666b req-9c1d28d3-666e-4a0d-801b-e4138333330d service nova] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:05:32.881497 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.compute.server_external_events [req-35c7bc7f-139f-47ef-af99-30aeaa15666b req-9c1d28d3-666e-4a0d-801b-e4138333330d service nova] Creating event network-changed:5a5ce414-6f70-43b5-a7cc-7340f679070a for instance ca231b38-fd3e-43ba-9cba-1de10a1ffeec on hv-cinder-76810 Jun 29 08:05:32.889309 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [req-35c7bc7f-139f-47ef-af99-30aeaa15666b req-9c1d28d3-666e-4a0d-801b-e4138333330d service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044572 Jun 29 08:05:32.891909 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 135/269] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jun 29 08:05:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:05:32.903620 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-a6697241-e277-402b-98a3-5e9e4ef013f8 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:05:32.904846 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-a6697241-e277-402b-98a3-5e9e4ef013f8 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] [instance: f99567d1-cadf-40c5-b1dc-f86739b2b16c] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:05:32.919819 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-a6697241-e277-402b-98a3-5e9e4ef013f8 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:05:32.920892 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-a6697241-e277-402b-98a3-5e9e4ef013f8 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:05:32.921983 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-a6697241-e277-402b-98a3-5e9e4ef013f8 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:05:32.922670 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-a6697241-e277-402b-98a3-5e9e4ef013f8 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:05:32.959450 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-dde3bb5e-831e-45ea-bd97-a3f59f725b7e tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4af4eedee24897be2e702ef51873b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab693125979f4bb7b7b3c94061610fe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:05:32.978243 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-dde3bb5e-831e-45ea-bd97-a3f59f725b7e tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] 10.222.0.43 "GET /compute/v2.1/servers/ca231b38-fd3e-43ba-9cba-1de10a1ffeec" status: 200 len: 1369 microversion: 2.1 time: 0.635015 Jun 29 08:05:32.981406 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 135/270] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:05:32 2022] GET /compute/v2.1/servers/ca231b38-fd3e-43ba-9cba-1de10a1ffeec => generated 1369 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:05:33.364573 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-5547b6c8-abcf-496a-bf2f-bad45f2dc0a9 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:05:33.387583 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-5547b6c8-abcf-496a-bf2f-bad45f2dc0a9 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] [instance: d5d97f9b-3f4a-4a5e-89e8-98d55412fe71] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:05:33.419366 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-5547b6c8-abcf-496a-bf2f-bad45f2dc0a9 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:05:33.421697 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-5547b6c8-abcf-496a-bf2f-bad45f2dc0a9 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:05:33.425715 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-5547b6c8-abcf-496a-bf2f-bad45f2dc0a9 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:05:33.430506 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-5547b6c8-abcf-496a-bf2f-bad45f2dc0a9 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:05:33.662821 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-a6697241-e277-402b-98a3-5e9e4ef013f8 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:05:33.698209 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-5547b6c8-abcf-496a-bf2f-bad45f2dc0a9 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c70c44993ab240b1a5231df4c9d550c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e0c37d941434569b3dbd07e22125210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:05:33.699683 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-a6697241-e277-402b-98a3-5e9e4ef013f8 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:05:33.711745 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-5547b6c8-abcf-496a-bf2f-bad45f2dc0a9 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] 10.222.0.43 "GET /compute/v2.1/servers/d5d97f9b-3f4a-4a5e-89e8-98d55412fe71" status: 200 len: 1709 microversion: 2.1 time: 0.365070 Jun 29 08:05:33.712817 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 136/271] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:05:33 2022] GET /compute/v2.1/servers/d5d97f9b-3f4a-4a5e-89e8-98d55412fe71 => generated 1709 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:05:33.727296 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-a6697241-e277-402b-98a3-5e9e4ef013f8 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:05:33.731831 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-a6697241-e277-402b-98a3-5e9e4ef013f8 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] 10.222.0.43 "GET /compute/v2.1/servers/f99567d1-cadf-40c5-b1dc-f86739b2b16c" status: 200 len: 1741 microversion: 2.20 time: 0.835308 Jun 29 08:05:33.732806 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 136/272] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 29 08:05:32 2022] GET /compute/v2.1/servers/f99567d1-cadf-40c5-b1dc-f86739b2b16c => generated 1741 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:05:34.006079 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-0e0dea5f-81de-4002-88bd-8e2c664051e4 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:05:34.007164 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-0e0dea5f-81de-4002-88bd-8e2c664051e4 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] [instance: ca231b38-fd3e-43ba-9cba-1de10a1ffeec] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:05:34.041651 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-0e0dea5f-81de-4002-88bd-8e2c664051e4 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:05:34.042140 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-0e0dea5f-81de-4002-88bd-8e2c664051e4 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:05:34.048471 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-0e0dea5f-81de-4002-88bd-8e2c664051e4 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:05:34.053463 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-0e0dea5f-81de-4002-88bd-8e2c664051e4 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:05:34.733636 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-9d6957c5-4dcb-4cb0-b88a-f1b6bd91dd97 tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Action: 'create', calling method: .version_select at 0x7f72417bb310>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-721615885", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPsq5R61EGqW7wOsMZUAwFwpsMkJXq+1VbmH6cBbyfySR+B0YokiHCe5SwkLsiMkv239NHGR+cgY7VD3ww3+f1mUEWbX4lJN77vVPypfhUiq3i//5PExBLKFZiFb488p7Q=="}} {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:05:34.791924 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.quota [None req-9d6957c5-4dcb-4cb0-b88a-f1b6bd91dd97 tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Getting quotas for project a7afb1bdb06042f4b983631745f32e19. Resources: {'key_pairs'} {{(pid=117890) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 29 08:05:34.799272 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.quota [None req-9d6957c5-4dcb-4cb0-b88a-f1b6bd91dd97 tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Getting quotas for user 6663857e60ca4440a9a620007be4c2c7 and project a7afb1bdb06042f4b983631745f32e19. Resources: {'key_pairs'} {{(pid=117890) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 29 08:05:34.833820 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-0e0dea5f-81de-4002-88bd-8e2c664051e4 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4af4eedee24897be2e702ef51873b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab693125979f4bb7b7b3c94061610fe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:05:34.840370 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-9d6957c5-4dcb-4cb0-b88a-f1b6bd91dd97 tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.110990 Jun 29 08:05:34.847050 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 137/273] 10.222.0.43 () {60 vars in 1158 bytes} [Wed Jun 29 08:05:34 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:05:34.865779 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-f3829088-a2c5-4420-afcf-04291e97f496 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:05:34.878488 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-0e0dea5f-81de-4002-88bd-8e2c664051e4 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] 10.222.0.43 "GET /compute/v2.1/servers/ca231b38-fd3e-43ba-9cba-1de10a1ffeec" status: 200 len: 1369 microversion: 2.1 time: 0.877287 Jun 29 08:05:34.883550 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-f3829088-a2c5-4420-afcf-04291e97f496 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] [instance: d5d97f9b-3f4a-4a5e-89e8-98d55412fe71] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:05:34.909880 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-f3829088-a2c5-4420-afcf-04291e97f496 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:05:34.910819 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-f3829088-a2c5-4420-afcf-04291e97f496 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:05:34.911292 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-f3829088-a2c5-4420-afcf-04291e97f496 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:05:34.917492 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 137/274] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:05:33 2022] GET /compute/v2.1/servers/ca231b38-fd3e-43ba-9cba-1de10a1ffeec => generated 1369 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:05:34.928505 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-f3829088-a2c5-4420-afcf-04291e97f496 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:05:34.939138 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-d74b4f3f-9d5f-4f06-8ccc-5ee1a4a0b5be tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:05:34.949584 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-d74b4f3f-9d5f-4f06-8ccc-5ee1a4a0b5be tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] [instance: f99567d1-cadf-40c5-b1dc-f86739b2b16c] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:05:34.986958 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-d74b4f3f-9d5f-4f06-8ccc-5ee1a4a0b5be tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:05:34.990107 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-d74b4f3f-9d5f-4f06-8ccc-5ee1a4a0b5be tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:05:34.991872 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-d74b4f3f-9d5f-4f06-8ccc-5ee1a4a0b5be tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:05:34.993113 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-d74b4f3f-9d5f-4f06-8ccc-5ee1a4a0b5be tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:05:35.421292 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-d74b4f3f-9d5f-4f06-8ccc-5ee1a4a0b5be tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:05:35.446492 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-d74b4f3f-9d5f-4f06-8ccc-5ee1a4a0b5be tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:05:35.447288 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-f3829088-a2c5-4420-afcf-04291e97f496 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c70c44993ab240b1a5231df4c9d550c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e0c37d941434569b3dbd07e22125210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:05:35.457722 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-d74b4f3f-9d5f-4f06-8ccc-5ee1a4a0b5be tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:05:35.459141 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-d74b4f3f-9d5f-4f06-8ccc-5ee1a4a0b5be tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] 10.222.0.43 "GET /compute/v2.1/servers/f99567d1-cadf-40c5-b1dc-f86739b2b16c" status: 200 len: 1741 microversion: 2.20 time: 0.540128 Jun 29 08:05:35.463127 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 138/275] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 29 08:05:34 2022] GET /compute/v2.1/servers/f99567d1-cadf-40c5-b1dc-f86739b2b16c => generated 1741 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:05:35.484824 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-f3829088-a2c5-4420-afcf-04291e97f496 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] 10.222.0.43 "GET /compute/v2.1/servers/d5d97f9b-3f4a-4a5e-89e8-98d55412fe71" status: 200 len: 1709 microversion: 2.1 time: 0.635940 Jun 29 08:05:35.485855 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 138/276] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:05:34 2022] GET /compute/v2.1/servers/d5d97f9b-3f4a-4a5e-89e8-98d55412fe71 => generated 1709 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:05:35.504085 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-87ef748a-c170-4795-89e2-fc994df850ec tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-79323308", "imageRef": "e60a6fae-fc4e-4b81-af6f-17e6ba2149f4", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-721615885", "networks": [{"uuid": "fc13a0b9-e34d-4650-bb88-8388325ba847"}]}} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:05:35.609673 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.network.neutron [None req-87ef748a-c170-4795-89e2-fc994df850ec tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] validate_networks() for [('fc13a0b9-e34d-4650-bb88-8388325ba847', None, None, None, None, None)] {{(pid=117889) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 29 08:05:35.911023 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-6bb1d047-42a8-4e9e-832d-b92091df8cfd tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:05:35.912220 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-6bb1d047-42a8-4e9e-832d-b92091df8cfd tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] [instance: ca231b38-fd3e-43ba-9cba-1de10a1ffeec] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:05:35.929919 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-6bb1d047-42a8-4e9e-832d-b92091df8cfd tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:05:35.932148 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-6bb1d047-42a8-4e9e-832d-b92091df8cfd tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:05:35.933399 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-6bb1d047-42a8-4e9e-832d-b92091df8cfd tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:05:35.935173 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-6bb1d047-42a8-4e9e-832d-b92091df8cfd tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:05:36.172967 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-6bb1d047-42a8-4e9e-832d-b92091df8cfd tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4af4eedee24897be2e702ef51873b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab693125979f4bb7b7b3c94061610fe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:05:36.206939 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-6bb1d047-42a8-4e9e-832d-b92091df8cfd tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] 10.222.0.43 "GET /compute/v2.1/servers/ca231b38-fd3e-43ba-9cba-1de10a1ffeec" status: 200 len: 1369 microversion: 2.1 time: 0.300478 Jun 29 08:05:36.221039 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 139/277] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:05:35 2022] GET /compute/v2.1/servers/ca231b38-fd3e-43ba-9cba-1de10a1ffeec => generated 1369 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 08:05:36.482328 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-8e82c2b4-8ca5-4d15-a81e-d3d902f5a3fc tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:05:36.483368 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-8e82c2b4-8ca5-4d15-a81e-d3d902f5a3fc tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] [instance: f99567d1-cadf-40c5-b1dc-f86739b2b16c] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:05:36.498961 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-8e82c2b4-8ca5-4d15-a81e-d3d902f5a3fc tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:05:36.499432 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-8e82c2b4-8ca5-4d15-a81e-d3d902f5a3fc tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:05:36.500719 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-8e82c2b4-8ca5-4d15-a81e-d3d902f5a3fc tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:05:36.501575 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-8e82c2b4-8ca5-4d15-a81e-d3d902f5a3fc tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:05:36.757713 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.virt.hardware [None req-87ef748a-c170-4795-89e2-fc994df850ec tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Flavor limits 0:0:0 {{(pid=117889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 29 08:05:36.758823 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.virt.hardware [None req-87ef748a-c170-4795-89e2-fc994df850ec tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Image limits 0:0:0 {{(pid=117889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 29 08:05:36.759534 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.virt.hardware [None req-87ef748a-c170-4795-89e2-fc994df850ec tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Flavor pref 0:0:0 {{(pid=117889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 29 08:05:36.760111 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.virt.hardware [None req-87ef748a-c170-4795-89e2-fc994df850ec tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Image pref 0:0:0 {{(pid=117889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 29 08:05:36.760700 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.virt.hardware [None req-87ef748a-c170-4795-89e2-fc994df850ec tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 29 08:05:36.789333 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-87ef748a-c170-4795-89e2-fc994df850ec tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:05:36.799235 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-87ef748a-c170-4795-89e2-fc994df850ec tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:05:36.809188 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-87ef748a-c170-4795-89e2-fc994df850ec tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:05:36.810024 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-87ef748a-c170-4795-89e2-fc994df850ec tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:05:36.874141 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.quota [None req-87ef748a-c170-4795-89e2-fc994df850ec tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Getting quotas for project a7afb1bdb06042f4b983631745f32e19. Resources: {'ram', 'instances', 'cores'} {{(pid=117889) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 29 08:05:36.895356 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.quota [None req-87ef748a-c170-4795-89e2-fc994df850ec tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Getting quotas for user 6663857e60ca4440a9a620007be4c2c7 and project a7afb1bdb06042f4b983631745f32e19. Resources: {'ram', 'instances', 'cores'} {{(pid=117889) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 29 08:05:36.970115 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-8e82c2b4-8ca5-4d15-a81e-d3d902f5a3fc tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:05:36.988193 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-8e82c2b4-8ca5-4d15-a81e-d3d902f5a3fc tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:05:36.990574 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-8e82c2b4-8ca5-4d15-a81e-d3d902f5a3fc tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:05:36.993871 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-8e82c2b4-8ca5-4d15-a81e-d3d902f5a3fc tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] 10.222.0.43 "GET /compute/v2.1/servers/f99567d1-cadf-40c5-b1dc-f86739b2b16c" status: 200 len: 1741 microversion: 2.20 time: 0.516405 Jun 29 08:05:36.998686 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 140/278] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 29 08:05:36 2022] GET /compute/v2.1/servers/f99567d1-cadf-40c5-b1dc-f86739b2b16c => generated 1741 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:05:37.004893 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-a93b22fc-e4f9-4e53-a216-786d324c2435 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:05:37.005872 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-a93b22fc-e4f9-4e53-a216-786d324c2435 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] [instance: d5d97f9b-3f4a-4a5e-89e8-98d55412fe71] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:05:37.016578 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-87ef748a-c170-4795-89e2-fc994df850ec tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Going to run 1 instances... {{(pid=117889) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 29 08:05:37.021435 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-a93b22fc-e4f9-4e53-a216-786d324c2435 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:05:37.021898 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-a93b22fc-e4f9-4e53-a216-786d324c2435 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:05:37.024558 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-87ef748a-c170-4795-89e2-fc994df850ec tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] [instance: 4a523b7d-76fc-4f57-9bfe-c9c2b4b0b8c8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e60a6fae-fc4e-4b81-af6f-17e6ba2149f4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117889) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 29 08:05:37.026185 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-a93b22fc-e4f9-4e53-a216-786d324c2435 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:05:37.026746 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-a93b22fc-e4f9-4e53-a216-786d324c2435 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:05:37.165840 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-87ef748a-c170-4795-89e2-fc994df850ec tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.698431 Jun 29 08:05:37.172549 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 139/279] 10.222.0.43 () {60 vars in 1146 bytes} [Wed Jun 29 08:05:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 1708 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 29 08:05:37.183890 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-fc4d45f6-c19d-43c5-b4c8-ed6899faac18 tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:05:37.184862 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-fc4d45f6-c19d-43c5-b4c8-ed6899faac18 tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] [instance: 4a523b7d-76fc-4f57-9bfe-c9c2b4b0b8c8] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:05:37.461614 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-fc4d45f6-c19d-43c5-b4c8-ed6899faac18 tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6663857e60ca4440a9a620007be4c2c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7afb1bdb06042f4b983631745f32e19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:05:37.507947 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-fc4d45f6-c19d-43c5-b4c8-ed6899faac18 tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] 10.222.0.43 "GET /compute/v2.1/servers/4a523b7d-76fc-4f57-9bfe-c9c2b4b0b8c8" status: 200 len: 1256 microversion: 2.1 time: 0.317005 Jun 29 08:05:37.513047 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 140/280] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:05:37 2022] GET /compute/v2.1/servers/4a523b7d-76fc-4f57-9bfe-c9c2b4b0b8c8 => generated 1256 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:05:37.531302 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-8c91aff6-5eb6-44ae-9a1e-76face18f3a0 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:05:37.532438 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-8c91aff6-5eb6-44ae-9a1e-76face18f3a0 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] [instance: ca231b38-fd3e-43ba-9cba-1de10a1ffeec] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:05:37.549199 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-8c91aff6-5eb6-44ae-9a1e-76face18f3a0 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:05:37.553120 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-8c91aff6-5eb6-44ae-9a1e-76face18f3a0 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:05:37.556205 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-8c91aff6-5eb6-44ae-9a1e-76face18f3a0 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:05:37.556597 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-a93b22fc-e4f9-4e53-a216-786d324c2435 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c70c44993ab240b1a5231df4c9d550c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e0c37d941434569b3dbd07e22125210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:05:37.557419 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-8c91aff6-5eb6-44ae-9a1e-76face18f3a0 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:05:37.569590 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-a93b22fc-e4f9-4e53-a216-786d324c2435 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] 10.222.0.43 "GET /compute/v2.1/servers/d5d97f9b-3f4a-4a5e-89e8-98d55412fe71" status: 200 len: 1709 microversion: 2.1 time: 0.569284 Jun 29 08:05:37.570515 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 141/281] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:05:36 2022] GET /compute/v2.1/servers/d5d97f9b-3f4a-4a5e-89e8-98d55412fe71 => generated 1709 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:05:38.018661 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-6152a220-b213-4489-9fa7-50ffffdfe9de tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:05:38.021043 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-6152a220-b213-4489-9fa7-50ffffdfe9de tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] [instance: f99567d1-cadf-40c5-b1dc-f86739b2b16c] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:05:38.045121 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-6152a220-b213-4489-9fa7-50ffffdfe9de tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:05:38.051523 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-6152a220-b213-4489-9fa7-50ffffdfe9de tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:05:38.054447 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-6152a220-b213-4489-9fa7-50ffffdfe9de tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:05:38.056186 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-6152a220-b213-4489-9fa7-50ffffdfe9de tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:05:38.067400 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-8c91aff6-5eb6-44ae-9a1e-76face18f3a0 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4af4eedee24897be2e702ef51873b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab693125979f4bb7b7b3c94061610fe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:05:38.081372 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-8c91aff6-5eb6-44ae-9a1e-76face18f3a0 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] 10.222.0.43 "GET /compute/v2.1/servers/ca231b38-fd3e-43ba-9cba-1de10a1ffeec" status: 200 len: 1369 microversion: 2.1 time: 0.565948 Jun 29 08:05:38.099161 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 141/282] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:05:37 2022] GET /compute/v2.1/servers/ca231b38-fd3e-43ba-9cba-1de10a1ffeec => generated 1369 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:05:38.514431 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-6152a220-b213-4489-9fa7-50ffffdfe9de tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:05:38.539550 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-f0817de7-115b-4b8a-afd4-d23e7ce7657d tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:05:38.542552 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-f0817de7-115b-4b8a-afd4-d23e7ce7657d tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] [instance: 4a523b7d-76fc-4f57-9bfe-c9c2b4b0b8c8] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:05:38.545834 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-6152a220-b213-4489-9fa7-50ffffdfe9de tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:05:38.557957 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-6152a220-b213-4489-9fa7-50ffffdfe9de tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:05:38.564474 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-6152a220-b213-4489-9fa7-50ffffdfe9de tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] 10.222.0.43 "GET /compute/v2.1/servers/f99567d1-cadf-40c5-b1dc-f86739b2b16c" status: 200 len: 1741 microversion: 2.20 time: 0.549033 Jun 29 08:05:38.566408 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 142/283] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 29 08:05:38 2022] GET /compute/v2.1/servers/f99567d1-cadf-40c5-b1dc-f86739b2b16c => generated 1741 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:05:38.584227 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-f0817de7-115b-4b8a-afd4-d23e7ce7657d tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:05:38.587583 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-f0817de7-115b-4b8a-afd4-d23e7ce7657d tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:05:38.589692 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-f0817de7-115b-4b8a-afd4-d23e7ce7657d tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:05:38.591196 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-f0817de7-115b-4b8a-afd4-d23e7ce7657d tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:05:38.605327 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-a13f79a8-cdc1-4d8d-b663-ef7db8e5f22a tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:05:38.606796 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-a13f79a8-cdc1-4d8d-b663-ef7db8e5f22a tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] [instance: d5d97f9b-3f4a-4a5e-89e8-98d55412fe71] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:05:38.616279 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-a13f79a8-cdc1-4d8d-b663-ef7db8e5f22a tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:05:38.617358 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-a13f79a8-cdc1-4d8d-b663-ef7db8e5f22a tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:05:38.618505 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-a13f79a8-cdc1-4d8d-b663-ef7db8e5f22a tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:05:38.619362 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-a13f79a8-cdc1-4d8d-b663-ef7db8e5f22a tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:05:38.865851 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-f0817de7-115b-4b8a-afd4-d23e7ce7657d tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6663857e60ca4440a9a620007be4c2c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7afb1bdb06042f4b983631745f32e19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:05:38.928908 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-f0817de7-115b-4b8a-afd4-d23e7ce7657d tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] 10.222.0.43 "GET /compute/v2.1/servers/4a523b7d-76fc-4f57-9bfe-c9c2b4b0b8c8" status: 200 len: 1260 microversion: 2.1 time: 0.399653 Jun 29 08:05:38.932038 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 142/284] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:05:38 2022] GET /compute/v2.1/servers/4a523b7d-76fc-4f57-9bfe-c9c2b4b0b8c8 => generated 1260 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:05:38.954258 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-a13f79a8-cdc1-4d8d-b663-ef7db8e5f22a tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c70c44993ab240b1a5231df4c9d550c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e0c37d941434569b3dbd07e22125210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:05:38.966142 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-a13f79a8-cdc1-4d8d-b663-ef7db8e5f22a tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] 10.222.0.43 "GET /compute/v2.1/servers/d5d97f9b-3f4a-4a5e-89e8-98d55412fe71" status: 200 len: 1713 microversion: 2.1 time: 0.366633 Jun 29 08:05:38.967986 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 143/285] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:05:38 2022] GET /compute/v2.1/servers/d5d97f9b-3f4a-4a5e-89e8-98d55412fe71 => generated 1713 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:05:39.114348 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-62cbc7f3-e8d4-4a22-a0d3-11d3ca3d5d3d tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:05:39.116570 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-62cbc7f3-e8d4-4a22-a0d3-11d3ca3d5d3d tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] [instance: ca231b38-fd3e-43ba-9cba-1de10a1ffeec] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:05:39.138254 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-62cbc7f3-e8d4-4a22-a0d3-11d3ca3d5d3d tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:05:39.139321 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-62cbc7f3-e8d4-4a22-a0d3-11d3ca3d5d3d tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:05:39.141063 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-62cbc7f3-e8d4-4a22-a0d3-11d3ca3d5d3d tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:05:39.142138 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-62cbc7f3-e8d4-4a22-a0d3-11d3ca3d5d3d tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:05:39.467200 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-62cbc7f3-e8d4-4a22-a0d3-11d3ca3d5d3d tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4af4eedee24897be2e702ef51873b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab693125979f4bb7b7b3c94061610fe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:05:39.477466 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-62cbc7f3-e8d4-4a22-a0d3-11d3ca3d5d3d tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] 10.222.0.43 "GET /compute/v2.1/servers/ca231b38-fd3e-43ba-9cba-1de10a1ffeec" status: 200 len: 1369 microversion: 2.1 time: 0.370847 Jun 29 08:05:39.479302 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 143/286] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:05:39 2022] GET /compute/v2.1/servers/ca231b38-fd3e-43ba-9cba-1de10a1ffeec => generated 1369 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:05:39.590721 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-19fe8b49-7973-4184-b7c5-2fb84a456881 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:05:39.592851 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-19fe8b49-7973-4184-b7c5-2fb84a456881 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] [instance: f99567d1-cadf-40c5-b1dc-f86739b2b16c] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:05:39.606629 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-19fe8b49-7973-4184-b7c5-2fb84a456881 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:05:39.608099 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-19fe8b49-7973-4184-b7c5-2fb84a456881 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:05:39.609807 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-19fe8b49-7973-4184-b7c5-2fb84a456881 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:05:39.611282 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-19fe8b49-7973-4184-b7c5-2fb84a456881 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:05:39.874419 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-19fe8b49-7973-4184-b7c5-2fb84a456881 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:05:39.886767 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-19fe8b49-7973-4184-b7c5-2fb84a456881 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:05:39.888777 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-19fe8b49-7973-4184-b7c5-2fb84a456881 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:05:39.890439 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-19fe8b49-7973-4184-b7c5-2fb84a456881 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] 10.222.0.43 "GET /compute/v2.1/servers/f99567d1-cadf-40c5-b1dc-f86739b2b16c" status: 200 len: 1741 microversion: 2.20 time: 0.307521 Jun 29 08:05:39.892276 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 144/287] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 29 08:05:39 2022] GET /compute/v2.1/servers/f99567d1-cadf-40c5-b1dc-f86739b2b16c => generated 1741 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 29 08:05:39.949773 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-9a82846e-1129-4ebf-a6a0-530968a4a2dc tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:05:39.950715 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-9a82846e-1129-4ebf-a6a0-530968a4a2dc tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] [instance: 4a523b7d-76fc-4f57-9bfe-c9c2b4b0b8c8] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:05:39.959226 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-9a82846e-1129-4ebf-a6a0-530968a4a2dc tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:05:39.959690 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-9a82846e-1129-4ebf-a6a0-530968a4a2dc tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:05:39.961177 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-9a82846e-1129-4ebf-a6a0-530968a4a2dc tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:05:39.964149 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-9a82846e-1129-4ebf-a6a0-530968a4a2dc tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:05:40.064177 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-9a82846e-1129-4ebf-a6a0-530968a4a2dc tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6663857e60ca4440a9a620007be4c2c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7afb1bdb06042f4b983631745f32e19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:05:40.073382 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-9a82846e-1129-4ebf-a6a0-530968a4a2dc tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] 10.222.0.43 "GET /compute/v2.1/servers/4a523b7d-76fc-4f57-9bfe-c9c2b4b0b8c8" status: 200 len: 1308 microversion: 2.1 time: 0.127990 Jun 29 08:05:40.074676 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 144/288] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:05:39 2022] GET /compute/v2.1/servers/4a523b7d-76fc-4f57-9bfe-c9c2b4b0b8c8 => generated 1308 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:05:40.499181 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-2b886b5f-f6e0-4479-8b41-b35976fd6255 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:05:40.504190 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-2b886b5f-f6e0-4479-8b41-b35976fd6255 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] [instance: ca231b38-fd3e-43ba-9cba-1de10a1ffeec] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:05:40.517442 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-2b886b5f-f6e0-4479-8b41-b35976fd6255 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:05:40.519274 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-2b886b5f-f6e0-4479-8b41-b35976fd6255 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:05:40.520419 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-2b886b5f-f6e0-4479-8b41-b35976fd6255 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:05:40.521229 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-2b886b5f-f6e0-4479-8b41-b35976fd6255 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:05:40.737999 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-2b886b5f-f6e0-4479-8b41-b35976fd6255 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4af4eedee24897be2e702ef51873b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab693125979f4bb7b7b3c94061610fe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:05:40.750115 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-2b886b5f-f6e0-4479-8b41-b35976fd6255 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] 10.222.0.43 "GET /compute/v2.1/servers/ca231b38-fd3e-43ba-9cba-1de10a1ffeec" status: 200 len: 1369 microversion: 2.1 time: 0.258061 Jun 29 08:05:40.760177 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 145/289] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:05:40 2022] GET /compute/v2.1/servers/ca231b38-fd3e-43ba-9cba-1de10a1ffeec => generated 1369 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:05:40.939231 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-30384746-d0b9-49f4-81b5-fcbc015225ad tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:05:40.949547 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-30384746-d0b9-49f4-81b5-fcbc015225ad tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] [instance: f99567d1-cadf-40c5-b1dc-f86739b2b16c] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:05:40.974429 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-30384746-d0b9-49f4-81b5-fcbc015225ad tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:05:40.974885 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-30384746-d0b9-49f4-81b5-fcbc015225ad tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:05:40.976652 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-30384746-d0b9-49f4-81b5-fcbc015225ad tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:05:40.977766 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-30384746-d0b9-49f4-81b5-fcbc015225ad tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:05:41.100291 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-7926ceaf-ef25-4861-8de6-898284a310e7 tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:05:41.103040 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-7926ceaf-ef25-4861-8de6-898284a310e7 tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] [instance: 4a523b7d-76fc-4f57-9bfe-c9c2b4b0b8c8] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:05:41.112628 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-7926ceaf-ef25-4861-8de6-898284a310e7 tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:05:41.113886 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-7926ceaf-ef25-4861-8de6-898284a310e7 tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:05:41.114922 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-7926ceaf-ef25-4861-8de6-898284a310e7 tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:05:41.116472 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-7926ceaf-ef25-4861-8de6-898284a310e7 tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:05:41.210120 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-30384746-d0b9-49f4-81b5-fcbc015225ad tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:05:41.217644 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-7926ceaf-ef25-4861-8de6-898284a310e7 tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6663857e60ca4440a9a620007be4c2c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7afb1bdb06042f4b983631745f32e19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:05:41.219442 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-30384746-d0b9-49f4-81b5-fcbc015225ad tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:05:41.221140 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-30384746-d0b9-49f4-81b5-fcbc015225ad tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:05:41.223185 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-30384746-d0b9-49f4-81b5-fcbc015225ad tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] 10.222.0.43 "GET /compute/v2.1/servers/f99567d1-cadf-40c5-b1dc-f86739b2b16c" status: 200 len: 1741 microversion: 2.20 time: 0.303951 Jun 29 08:05:41.235710 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-7926ceaf-ef25-4861-8de6-898284a310e7 tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] 10.222.0.43 "GET /compute/v2.1/servers/4a523b7d-76fc-4f57-9bfe-c9c2b4b0b8c8" status: 200 len: 1308 microversion: 2.1 time: 0.133245 Jun 29 08:05:41.235710 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 146/290] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:05:41 2022] GET /compute/v2.1/servers/4a523b7d-76fc-4f57-9bfe-c9c2b4b0b8c8 => generated 1308 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 08:05:41.236587 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 145/291] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 29 08:05:40 2022] GET /compute/v2.1/servers/f99567d1-cadf-40c5-b1dc-f86739b2b16c => generated 1741 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:05:41.770305 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-6da85a5b-9630-4c12-96fc-0eb64804beb3 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:05:41.771663 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-6da85a5b-9630-4c12-96fc-0eb64804beb3 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] [instance: ca231b38-fd3e-43ba-9cba-1de10a1ffeec] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:05:41.779902 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-6da85a5b-9630-4c12-96fc-0eb64804beb3 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:05:41.780464 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-6da85a5b-9630-4c12-96fc-0eb64804beb3 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:05:41.781611 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-6da85a5b-9630-4c12-96fc-0eb64804beb3 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:05:41.782307 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-6da85a5b-9630-4c12-96fc-0eb64804beb3 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:05:42.028907 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-6da85a5b-9630-4c12-96fc-0eb64804beb3 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4af4eedee24897be2e702ef51873b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab693125979f4bb7b7b3c94061610fe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:05:42.049264 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-6da85a5b-9630-4c12-96fc-0eb64804beb3 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] 10.222.0.43 "GET /compute/v2.1/servers/ca231b38-fd3e-43ba-9cba-1de10a1ffeec" status: 200 len: 1369 microversion: 2.1 time: 0.283280 Jun 29 08:05:42.065293 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 147/292] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:05:41 2022] GET /compute/v2.1/servers/ca231b38-fd3e-43ba-9cba-1de10a1ffeec => generated 1369 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 08:05:42.247303 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-cdd77212-d94a-4337-b91d-bd4223688eb1 tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:05:42.248021 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-cdd77212-d94a-4337-b91d-bd4223688eb1 tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] [instance: 4a523b7d-76fc-4f57-9bfe-c9c2b4b0b8c8] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:05:42.248845 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-e2b0b0e9-211d-4da7-ab5a-9ca7d8fa9ffd tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:05:42.251363 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-e2b0b0e9-211d-4da7-ab5a-9ca7d8fa9ffd tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] [instance: f99567d1-cadf-40c5-b1dc-f86739b2b16c] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:05:42.256359 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-cdd77212-d94a-4337-b91d-bd4223688eb1 tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:05:42.256890 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-cdd77212-d94a-4337-b91d-bd4223688eb1 tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:05:42.257993 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-cdd77212-d94a-4337-b91d-bd4223688eb1 tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:05:42.258396 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-cdd77212-d94a-4337-b91d-bd4223688eb1 tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:05:42.263781 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e2b0b0e9-211d-4da7-ab5a-9ca7d8fa9ffd tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:05:42.273625 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e2b0b0e9-211d-4da7-ab5a-9ca7d8fa9ffd tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:05:42.273625 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e2b0b0e9-211d-4da7-ab5a-9ca7d8fa9ffd tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:05:42.273625 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e2b0b0e9-211d-4da7-ab5a-9ca7d8fa9ffd tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:05:42.434089 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-cdd77212-d94a-4337-b91d-bd4223688eb1 tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6663857e60ca4440a9a620007be4c2c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7afb1bdb06042f4b983631745f32e19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:05:42.453890 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-cdd77212-d94a-4337-b91d-bd4223688eb1 tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] 10.222.0.43 "GET /compute/v2.1/servers/4a523b7d-76fc-4f57-9bfe-c9c2b4b0b8c8" status: 200 len: 1308 microversion: 2.1 time: 0.210459 Jun 29 08:05:42.464312 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 148/293] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:05:42 2022] GET /compute/v2.1/servers/4a523b7d-76fc-4f57-9bfe-c9c2b4b0b8c8 => generated 1308 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 08:05:42.532375 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-e2b0b0e9-211d-4da7-ab5a-9ca7d8fa9ffd tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:05:42.549671 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-e2b0b0e9-211d-4da7-ab5a-9ca7d8fa9ffd tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:05:42.555396 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-e2b0b0e9-211d-4da7-ab5a-9ca7d8fa9ffd tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:05:42.559700 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-e2b0b0e9-211d-4da7-ab5a-9ca7d8fa9ffd tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] 10.222.0.43 "GET /compute/v2.1/servers/f99567d1-cadf-40c5-b1dc-f86739b2b16c" status: 200 len: 1741 microversion: 2.20 time: 0.318508 Jun 29 08:05:42.569518 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 146/294] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 29 08:05:42 2022] GET /compute/v2.1/servers/f99567d1-cadf-40c5-b1dc-f86739b2b16c => generated 1741 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:05:43.094610 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-9a953cc3-77ba-4da4-83ed-d4e109ea2f64 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:05:43.095667 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-9a953cc3-77ba-4da4-83ed-d4e109ea2f64 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] [instance: ca231b38-fd3e-43ba-9cba-1de10a1ffeec] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:05:43.153861 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-9a953cc3-77ba-4da4-83ed-d4e109ea2f64 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:05:43.155917 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-9a953cc3-77ba-4da4-83ed-d4e109ea2f64 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:05:43.162551 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-9a953cc3-77ba-4da4-83ed-d4e109ea2f64 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:05:43.164102 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-9a953cc3-77ba-4da4-83ed-d4e109ea2f64 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:05:43.473676 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-9f2f7bba-4f49-47b4-b310-828a05b6a972 tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:05:43.475391 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-9f2f7bba-4f49-47b4-b310-828a05b6a972 tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] [instance: 4a523b7d-76fc-4f57-9bfe-c9c2b4b0b8c8] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:05:43.489306 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-9f2f7bba-4f49-47b4-b310-828a05b6a972 tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:05:43.491157 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-9f2f7bba-4f49-47b4-b310-828a05b6a972 tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:05:43.496437 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-9f2f7bba-4f49-47b4-b310-828a05b6a972 tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:05:43.497207 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-9f2f7bba-4f49-47b4-b310-828a05b6a972 tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:05:43.531244 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-9a953cc3-77ba-4da4-83ed-d4e109ea2f64 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4af4eedee24897be2e702ef51873b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab693125979f4bb7b7b3c94061610fe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:05:43.531244 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-9a953cc3-77ba-4da4-83ed-d4e109ea2f64 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] 10.222.0.43 "GET /compute/v2.1/servers/ca231b38-fd3e-43ba-9cba-1de10a1ffeec" status: 200 len: 1369 microversion: 2.1 time: 0.443087 Jun 29 08:05:43.531244 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 149/295] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:05:43 2022] GET /compute/v2.1/servers/ca231b38-fd3e-43ba-9cba-1de10a1ffeec => generated 1369 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:05:43.579750 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-fefcf8e1-3721-4144-ba76-b05af1c1eb96 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:05:43.581424 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-fefcf8e1-3721-4144-ba76-b05af1c1eb96 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] [instance: f99567d1-cadf-40c5-b1dc-f86739b2b16c] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:05:43.588712 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-fefcf8e1-3721-4144-ba76-b05af1c1eb96 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:05:43.589292 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-fefcf8e1-3721-4144-ba76-b05af1c1eb96 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:05:43.590205 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-fefcf8e1-3721-4144-ba76-b05af1c1eb96 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:05:43.590720 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-fefcf8e1-3721-4144-ba76-b05af1c1eb96 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:05:43.600270 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-9f2f7bba-4f49-47b4-b310-828a05b6a972 tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6663857e60ca4440a9a620007be4c2c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7afb1bdb06042f4b983631745f32e19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:05:43.618045 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-9f2f7bba-4f49-47b4-b310-828a05b6a972 tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] 10.222.0.43 "GET /compute/v2.1/servers/4a523b7d-76fc-4f57-9bfe-c9c2b4b0b8c8" status: 200 len: 1308 microversion: 2.1 time: 0.149748 Jun 29 08:05:43.619237 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 147/296] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:05:43 2022] GET /compute/v2.1/servers/4a523b7d-76fc-4f57-9bfe-c9c2b4b0b8c8 => generated 1308 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:05:43.793220 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-fefcf8e1-3721-4144-ba76-b05af1c1eb96 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:05:43.808825 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-fefcf8e1-3721-4144-ba76-b05af1c1eb96 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:05:43.811818 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-fefcf8e1-3721-4144-ba76-b05af1c1eb96 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:05:43.814345 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-fefcf8e1-3721-4144-ba76-b05af1c1eb96 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] 10.222.0.43 "GET /compute/v2.1/servers/f99567d1-cadf-40c5-b1dc-f86739b2b16c" status: 200 len: 1741 microversion: 2.20 time: 0.238513 Jun 29 08:05:43.815708 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 150/297] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 29 08:05:43 2022] GET /compute/v2.1/servers/f99567d1-cadf-40c5-b1dc-f86739b2b16c => generated 1741 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 29 08:05:44.554585 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-79a8d61f-ca7b-4142-a723-4062858ea081 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:05:44.556677 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-79a8d61f-ca7b-4142-a723-4062858ea081 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] [instance: ca231b38-fd3e-43ba-9cba-1de10a1ffeec] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:05:44.564451 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-79a8d61f-ca7b-4142-a723-4062858ea081 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:05:44.565839 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-79a8d61f-ca7b-4142-a723-4062858ea081 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:05:44.566952 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-79a8d61f-ca7b-4142-a723-4062858ea081 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:05:44.567648 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-79a8d61f-ca7b-4142-a723-4062858ea081 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:05:44.639590 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-27dcfbce-1db2-4a82-9fae-ff0e5f3d15ac tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:05:44.641339 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-27dcfbce-1db2-4a82-9fae-ff0e5f3d15ac tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] [instance: 4a523b7d-76fc-4f57-9bfe-c9c2b4b0b8c8] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:05:44.654003 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-27dcfbce-1db2-4a82-9fae-ff0e5f3d15ac tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:05:44.655484 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-27dcfbce-1db2-4a82-9fae-ff0e5f3d15ac tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:05:44.657241 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-27dcfbce-1db2-4a82-9fae-ff0e5f3d15ac tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:05:44.658897 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-27dcfbce-1db2-4a82-9fae-ff0e5f3d15ac tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:05:44.693234 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG dbcounter [-] [117890] Writing DB stats nova_cell1:SELECT=100 {{(pid=117890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:05:44.782556 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-79a8d61f-ca7b-4142-a723-4062858ea081 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4af4eedee24897be2e702ef51873b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab693125979f4bb7b7b3c94061610fe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:05:44.786299 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-27dcfbce-1db2-4a82-9fae-ff0e5f3d15ac tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6663857e60ca4440a9a620007be4c2c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7afb1bdb06042f4b983631745f32e19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:05:44.802718 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-79a8d61f-ca7b-4142-a723-4062858ea081 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] 10.222.0.43 "GET /compute/v2.1/servers/ca231b38-fd3e-43ba-9cba-1de10a1ffeec" status: 200 len: 1369 microversion: 2.1 time: 0.258030 Jun 29 08:05:44.803728 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 148/298] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:05:44 2022] GET /compute/v2.1/servers/ca231b38-fd3e-43ba-9cba-1de10a1ffeec => generated 1369 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:05:44.805873 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-27dcfbce-1db2-4a82-9fae-ff0e5f3d15ac tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] 10.222.0.43 "GET /compute/v2.1/servers/4a523b7d-76fc-4f57-9bfe-c9c2b4b0b8c8" status: 200 len: 1308 microversion: 2.1 time: 0.172145 Jun 29 08:05:44.807241 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 151/299] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:05:44 2022] GET /compute/v2.1/servers/4a523b7d-76fc-4f57-9bfe-c9c2b4b0b8c8 => generated 1308 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:05:44.848232 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-9d706f23-54ba-4478-951f-1b5ed63266b3 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:05:44.850480 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-9d706f23-54ba-4478-951f-1b5ed63266b3 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] [instance: f99567d1-cadf-40c5-b1dc-f86739b2b16c] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:05:44.860135 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-9d706f23-54ba-4478-951f-1b5ed63266b3 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:05:44.860889 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-9d706f23-54ba-4478-951f-1b5ed63266b3 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:05:44.862543 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-9d706f23-54ba-4478-951f-1b5ed63266b3 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:05:44.863038 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-9d706f23-54ba-4478-951f-1b5ed63266b3 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:05:44.886048 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_cell1:SELECT=100 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:05:45.055229 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-9d706f23-54ba-4478-951f-1b5ed63266b3 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:05:45.065448 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-9d706f23-54ba-4478-951f-1b5ed63266b3 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:05:45.068142 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-9d706f23-54ba-4478-951f-1b5ed63266b3 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:05:45.069542 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-9d706f23-54ba-4478-951f-1b5ed63266b3 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] 10.222.0.43 "GET /compute/v2.1/servers/f99567d1-cadf-40c5-b1dc-f86739b2b16c" status: 200 len: 1741 microversion: 2.20 time: 0.229099 Jun 29 08:05:45.070642 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 149/300] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 29 08:05:44 2022] GET /compute/v2.1/servers/f99567d1-cadf-40c5-b1dc-f86739b2b16c => generated 1741 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:05:45.823766 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-bd271e86-490f-42ce-b3a2-ff1246e6f08d tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:05:45.824474 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-bd271e86-490f-42ce-b3a2-ff1246e6f08d tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] [instance: ca231b38-fd3e-43ba-9cba-1de10a1ffeec] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:05:45.831788 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-e635d457-af97-429f-b872-4d011ed4e996 tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:05:45.833167 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-e635d457-af97-429f-b872-4d011ed4e996 tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] [instance: 4a523b7d-76fc-4f57-9bfe-c9c2b4b0b8c8] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:05:45.833526 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG dbcounter [-] [117890] Writing DB stats nova_cell0:SELECT=8 {{(pid=117890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:05:45.837324 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-bd271e86-490f-42ce-b3a2-ff1246e6f08d tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:05:45.838478 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-bd271e86-490f-42ce-b3a2-ff1246e6f08d tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:05:45.840120 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-bd271e86-490f-42ce-b3a2-ff1246e6f08d tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:05:45.841768 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-bd271e86-490f-42ce-b3a2-ff1246e6f08d tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:05:45.845551 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e635d457-af97-429f-b872-4d011ed4e996 tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:05:45.846343 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e635d457-af97-429f-b872-4d011ed4e996 tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:05:45.847771 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e635d457-af97-429f-b872-4d011ed4e996 tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:05:45.848536 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e635d457-af97-429f-b872-4d011ed4e996 tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:05:45.989770 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-e635d457-af97-429f-b872-4d011ed4e996 tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6663857e60ca4440a9a620007be4c2c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7afb1bdb06042f4b983631745f32e19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:05:45.999531 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-e635d457-af97-429f-b872-4d011ed4e996 tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] 10.222.0.43 "GET /compute/v2.1/servers/4a523b7d-76fc-4f57-9bfe-c9c2b4b0b8c8" status: 200 len: 1308 microversion: 2.1 time: 0.175494 Jun 29 08:05:46.000135 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 150/301] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:05:45 2022] GET /compute/v2.1/servers/4a523b7d-76fc-4f57-9bfe-c9c2b4b0b8c8 => generated 1308 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:05:46.092714 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-53e93c5a-aa00-42fa-b705-c024ca266572 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:05:46.094112 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-53e93c5a-aa00-42fa-b705-c024ca266572 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] [instance: f99567d1-cadf-40c5-b1dc-f86739b2b16c] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:05:46.116561 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-53e93c5a-aa00-42fa-b705-c024ca266572 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:05:46.117992 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-53e93c5a-aa00-42fa-b705-c024ca266572 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:05:46.119663 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-53e93c5a-aa00-42fa-b705-c024ca266572 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:05:46.120532 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-53e93c5a-aa00-42fa-b705-c024ca266572 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:05:46.196283 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-bd271e86-490f-42ce-b3a2-ff1246e6f08d tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4af4eedee24897be2e702ef51873b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab693125979f4bb7b7b3c94061610fe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:05:46.243299 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-bd271e86-490f-42ce-b3a2-ff1246e6f08d tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] 10.222.0.43 "GET /compute/v2.1/servers/ca231b38-fd3e-43ba-9cba-1de10a1ffeec" status: 200 len: 1369 microversion: 2.1 time: 0.425436 Jun 29 08:05:46.245412 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 152/302] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:05:45 2022] GET /compute/v2.1/servers/ca231b38-fd3e-43ba-9cba-1de10a1ffeec => generated 1369 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:05:46.381917 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-53e93c5a-aa00-42fa-b705-c024ca266572 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:05:46.395543 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-53e93c5a-aa00-42fa-b705-c024ca266572 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:05:46.397506 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-53e93c5a-aa00-42fa-b705-c024ca266572 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:05:46.398811 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-53e93c5a-aa00-42fa-b705-c024ca266572 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] 10.222.0.43 "GET /compute/v2.1/servers/f99567d1-cadf-40c5-b1dc-f86739b2b16c" status: 200 len: 1741 microversion: 2.20 time: 0.313229 Jun 29 08:05:46.399661 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 151/303] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 29 08:05:46 2022] GET /compute/v2.1/servers/f99567d1-cadf-40c5-b1dc-f86739b2b16c => generated 1741 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 29 08:05:47.019928 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-7ebbd25b-8342-4eea-9690-6cbdc8e01454 tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:05:47.020590 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-7ebbd25b-8342-4eea-9690-6cbdc8e01454 tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] [instance: 4a523b7d-76fc-4f57-9bfe-c9c2b4b0b8c8] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:05:47.028249 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-7ebbd25b-8342-4eea-9690-6cbdc8e01454 tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:05:47.028699 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-7ebbd25b-8342-4eea-9690-6cbdc8e01454 tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:05:47.029545 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-7ebbd25b-8342-4eea-9690-6cbdc8e01454 tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:05:47.029983 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-7ebbd25b-8342-4eea-9690-6cbdc8e01454 tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:05:47.107237 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-7ebbd25b-8342-4eea-9690-6cbdc8e01454 tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6663857e60ca4440a9a620007be4c2c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7afb1bdb06042f4b983631745f32e19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:05:47.119693 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-7ebbd25b-8342-4eea-9690-6cbdc8e01454 tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] 10.222.0.43 "GET /compute/v2.1/servers/4a523b7d-76fc-4f57-9bfe-c9c2b4b0b8c8" status: 200 len: 1308 microversion: 2.1 time: 0.104271 Jun 29 08:05:47.120822 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 153/304] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:05:47 2022] GET /compute/v2.1/servers/4a523b7d-76fc-4f57-9bfe-c9c2b4b0b8c8 => generated 1308 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:05:47.264251 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-5b61ee54-4852-4713-9fb5-80e7867a5502 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:05:47.264926 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-5b61ee54-4852-4713-9fb5-80e7867a5502 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] [instance: ca231b38-fd3e-43ba-9cba-1de10a1ffeec] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:05:47.267491 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_cell0:SELECT=2 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:05:47.273806 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-5b61ee54-4852-4713-9fb5-80e7867a5502 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:05:47.274157 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-5b61ee54-4852-4713-9fb5-80e7867a5502 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:05:47.274996 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-5b61ee54-4852-4713-9fb5-80e7867a5502 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:05:47.275451 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-5b61ee54-4852-4713-9fb5-80e7867a5502 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:05:47.425370 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-afa54308-c9e7-4eeb-98a2-c75b6be39a7a tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:05:47.428092 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-afa54308-c9e7-4eeb-98a2-c75b6be39a7a tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] [instance: f99567d1-cadf-40c5-b1dc-f86739b2b16c] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:05:47.443367 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-afa54308-c9e7-4eeb-98a2-c75b6be39a7a tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:05:47.444597 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-afa54308-c9e7-4eeb-98a2-c75b6be39a7a tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:05:47.446151 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-afa54308-c9e7-4eeb-98a2-c75b6be39a7a tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:05:47.447378 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-afa54308-c9e7-4eeb-98a2-c75b6be39a7a tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:05:47.480301 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_cell0:SELECT=8 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:05:47.658995 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-afa54308-c9e7-4eeb-98a2-c75b6be39a7a tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:05:47.663788 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-5b61ee54-4852-4713-9fb5-80e7867a5502 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4af4eedee24897be2e702ef51873b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab693125979f4bb7b7b3c94061610fe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:05:47.674403 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-afa54308-c9e7-4eeb-98a2-c75b6be39a7a tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:05:47.676948 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-afa54308-c9e7-4eeb-98a2-c75b6be39a7a tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:05:47.678863 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-afa54308-c9e7-4eeb-98a2-c75b6be39a7a tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] 10.222.0.43 "GET /compute/v2.1/servers/f99567d1-cadf-40c5-b1dc-f86739b2b16c" status: 200 len: 1741 microversion: 2.20 time: 0.263055 Jun 29 08:05:47.684235 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-5b61ee54-4852-4713-9fb5-80e7867a5502 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] 10.222.0.43 "GET /compute/v2.1/servers/ca231b38-fd3e-43ba-9cba-1de10a1ffeec" status: 200 len: 1369 microversion: 2.1 time: 0.423804 Jun 29 08:05:47.692401 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 154/305] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 29 08:05:47 2022] GET /compute/v2.1/servers/f99567d1-cadf-40c5-b1dc-f86739b2b16c => generated 1741 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 29 08:05:47.693322 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 152/306] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:05:47 2022] GET /compute/v2.1/servers/ca231b38-fd3e-43ba-9cba-1de10a1ffeec => generated 1369 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:05:48.139803 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-5b699e67-b9eb-4fd7-b829-2c3038828856 tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:05:48.141201 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-5b699e67-b9eb-4fd7-b829-2c3038828856 tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] [instance: 4a523b7d-76fc-4f57-9bfe-c9c2b4b0b8c8] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:05:48.154219 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-5b699e67-b9eb-4fd7-b829-2c3038828856 tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:05:48.154716 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-5b699e67-b9eb-4fd7-b829-2c3038828856 tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:05:48.155604 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-5b699e67-b9eb-4fd7-b829-2c3038828856 tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:05:48.156131 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-5b699e67-b9eb-4fd7-b829-2c3038828856 tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:05:48.286049 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-5b699e67-b9eb-4fd7-b829-2c3038828856 tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6663857e60ca4440a9a620007be4c2c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7afb1bdb06042f4b983631745f32e19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:05:48.302416 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-5b699e67-b9eb-4fd7-b829-2c3038828856 tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] 10.222.0.43 "GET /compute/v2.1/servers/4a523b7d-76fc-4f57-9bfe-c9c2b4b0b8c8" status: 200 len: 1314 microversion: 2.1 time: 0.166527 Jun 29 08:05:48.316474 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 155/307] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:05:48 2022] GET /compute/v2.1/servers/4a523b7d-76fc-4f57-9bfe-c9c2b4b0b8c8 => generated 1314 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 08:05:48.704367 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-0a4e3ae4-b509-4c98-b1e0-3738f83de3f8 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:05:48.706509 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-0a4e3ae4-b509-4c98-b1e0-3738f83de3f8 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] [instance: f99567d1-cadf-40c5-b1dc-f86739b2b16c] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:05:48.718078 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-c4092bd0-bf1c-44f3-a82e-3da893eee62b tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:05:48.720310 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-c4092bd0-bf1c-44f3-a82e-3da893eee62b tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] [instance: ca231b38-fd3e-43ba-9cba-1de10a1ffeec] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:05:48.723655 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-0a4e3ae4-b509-4c98-b1e0-3738f83de3f8 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:05:48.724246 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-0a4e3ae4-b509-4c98-b1e0-3738f83de3f8 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:05:48.725223 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-0a4e3ae4-b509-4c98-b1e0-3738f83de3f8 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:05:48.725750 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-0a4e3ae4-b509-4c98-b1e0-3738f83de3f8 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:05:48.739523 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-c4092bd0-bf1c-44f3-a82e-3da893eee62b tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:05:48.740396 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-c4092bd0-bf1c-44f3-a82e-3da893eee62b tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:05:48.741661 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-c4092bd0-bf1c-44f3-a82e-3da893eee62b tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:05:48.744197 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-c4092bd0-bf1c-44f3-a82e-3da893eee62b tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:05:49.212769 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-c4092bd0-bf1c-44f3-a82e-3da893eee62b tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4af4eedee24897be2e702ef51873b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab693125979f4bb7b7b3c94061610fe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:05:49.220582 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-0a4e3ae4-b509-4c98-b1e0-3738f83de3f8 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:05:49.227076 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-c4092bd0-bf1c-44f3-a82e-3da893eee62b tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] 10.222.0.43 "GET /compute/v2.1/servers/ca231b38-fd3e-43ba-9cba-1de10a1ffeec" status: 200 len: 1369 microversion: 2.1 time: 0.516412 Jun 29 08:05:49.229311 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 156/308] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:05:48 2022] GET /compute/v2.1/servers/ca231b38-fd3e-43ba-9cba-1de10a1ffeec => generated 1369 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:05:49.261978 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-0a4e3ae4-b509-4c98-b1e0-3738f83de3f8 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:05:49.264862 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-0a4e3ae4-b509-4c98-b1e0-3738f83de3f8 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:05:49.271506 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-0a4e3ae4-b509-4c98-b1e0-3738f83de3f8 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] 10.222.0.43 "GET /compute/v2.1/servers/f99567d1-cadf-40c5-b1dc-f86739b2b16c" status: 200 len: 1723 microversion: 2.20 time: 0.570609 Jun 29 08:05:49.274075 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 153/309] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 29 08:05:48 2022] GET /compute/v2.1/servers/f99567d1-cadf-40c5-b1dc-f86739b2b16c => generated 1723 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:05:49.326877 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-9a5ddeb2-8bba-4954-8bd6-589be2c8f32a tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:05:49.328365 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-9a5ddeb2-8bba-4954-8bd6-589be2c8f32a tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] [instance: 4a523b7d-76fc-4f57-9bfe-c9c2b4b0b8c8] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:05:49.357641 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-9a5ddeb2-8bba-4954-8bd6-589be2c8f32a tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:05:49.365308 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-9a5ddeb2-8bba-4954-8bd6-589be2c8f32a tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:05:49.367577 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-9a5ddeb2-8bba-4954-8bd6-589be2c8f32a tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:05:49.368900 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-9a5ddeb2-8bba-4954-8bd6-589be2c8f32a tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:05:49.603707 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-9a5ddeb2-8bba-4954-8bd6-589be2c8f32a tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6663857e60ca4440a9a620007be4c2c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7afb1bdb06042f4b983631745f32e19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:05:49.617646 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-9a5ddeb2-8bba-4954-8bd6-589be2c8f32a tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] 10.222.0.43 "GET /compute/v2.1/servers/4a523b7d-76fc-4f57-9bfe-c9c2b4b0b8c8" status: 200 len: 1356 microversion: 2.1 time: 0.299017 Jun 29 08:05:49.618724 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 157/310] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:05:49 2022] GET /compute/v2.1/servers/4a523b7d-76fc-4f57-9bfe-c9c2b4b0b8c8 => generated 1356 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 08:05:50.264052 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-50cbb440-134c-4ad2-85f4-713cfa8d979c tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:05:50.264760 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-50cbb440-134c-4ad2-85f4-713cfa8d979c tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] [instance: ca231b38-fd3e-43ba-9cba-1de10a1ffeec] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:05:50.277887 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-50cbb440-134c-4ad2-85f4-713cfa8d979c tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:05:50.278631 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-50cbb440-134c-4ad2-85f4-713cfa8d979c tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:05:50.280013 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-50cbb440-134c-4ad2-85f4-713cfa8d979c tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:05:50.280738 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-50cbb440-134c-4ad2-85f4-713cfa8d979c tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:05:50.308300 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-45ba9481-f4bd-47fb-8bb2-a36c88dbe377 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:05:50.309373 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-45ba9481-f4bd-47fb-8bb2-a36c88dbe377 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] [instance: f99567d1-cadf-40c5-b1dc-f86739b2b16c] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:05:50.325664 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-45ba9481-f4bd-47fb-8bb2-a36c88dbe377 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:05:50.326417 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-45ba9481-f4bd-47fb-8bb2-a36c88dbe377 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:05:50.328397 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-45ba9481-f4bd-47fb-8bb2-a36c88dbe377 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:05:50.329145 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-45ba9481-f4bd-47fb-8bb2-a36c88dbe377 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:05:50.508250 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-50cbb440-134c-4ad2-85f4-713cfa8d979c tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4af4eedee24897be2e702ef51873b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab693125979f4bb7b7b3c94061610fe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:05:50.519244 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-50cbb440-134c-4ad2-85f4-713cfa8d979c tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] 10.222.0.43 "GET /compute/v2.1/servers/ca231b38-fd3e-43ba-9cba-1de10a1ffeec" status: 200 len: 1369 microversion: 2.1 time: 0.259514 Jun 29 08:05:50.519832 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 154/311] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:05:50 2022] GET /compute/v2.1/servers/ca231b38-fd3e-43ba-9cba-1de10a1ffeec => generated 1369 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 08:05:50.525787 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-45ba9481-f4bd-47fb-8bb2-a36c88dbe377 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:05:50.540807 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-45ba9481-f4bd-47fb-8bb2-a36c88dbe377 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:05:50.542556 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-45ba9481-f4bd-47fb-8bb2-a36c88dbe377 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:05:50.543804 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-45ba9481-f4bd-47fb-8bb2-a36c88dbe377 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] 10.222.0.43 "GET /compute/v2.1/servers/f99567d1-cadf-40c5-b1dc-f86739b2b16c" status: 200 len: 1723 microversion: 2.20 time: 0.240862 Jun 29 08:05:50.544468 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 158/312] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 29 08:05:50 2022] GET /compute/v2.1/servers/f99567d1-cadf-40c5-b1dc-f86739b2b16c => generated 1723 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:05:50.644502 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-185a9c4b-fae2-41a9-8b14-9f85d295306d tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:05:50.645283 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-185a9c4b-fae2-41a9-8b14-9f85d295306d tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] [instance: 4a523b7d-76fc-4f57-9bfe-c9c2b4b0b8c8] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:05:50.652251 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-185a9c4b-fae2-41a9-8b14-9f85d295306d tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:05:50.652702 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-185a9c4b-fae2-41a9-8b14-9f85d295306d tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:05:50.653545 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-185a9c4b-fae2-41a9-8b14-9f85d295306d tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:05:50.653990 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-185a9c4b-fae2-41a9-8b14-9f85d295306d tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:05:50.815823 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-185a9c4b-fae2-41a9-8b14-9f85d295306d tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6663857e60ca4440a9a620007be4c2c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7afb1bdb06042f4b983631745f32e19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:05:50.824265 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-185a9c4b-fae2-41a9-8b14-9f85d295306d tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] 10.222.0.43 "GET /compute/v2.1/servers/4a523b7d-76fc-4f57-9bfe-c9c2b4b0b8c8" status: 200 len: 1356 microversion: 2.1 time: 0.184422 Jun 29 08:05:50.824865 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 155/313] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:05:50 2022] GET /compute/v2.1/servers/4a523b7d-76fc-4f57-9bfe-c9c2b4b0b8c8 => generated 1356 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 08:05:51.545882 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-cf774520-a2eb-476a-9faa-c770bab933da tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:05:51.546482 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-cf774520-a2eb-476a-9faa-c770bab933da tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] [instance: ca231b38-fd3e-43ba-9cba-1de10a1ffeec] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:05:51.556586 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-cf774520-a2eb-476a-9faa-c770bab933da tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:05:51.559146 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-cf774520-a2eb-476a-9faa-c770bab933da tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:05:51.560945 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-cf774520-a2eb-476a-9faa-c770bab933da tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:05:51.561706 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-cf774520-a2eb-476a-9faa-c770bab933da tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:05:51.572227 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-413988f6-eadd-4dde-b67f-d38d8e3ad399 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:05:51.574230 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-413988f6-eadd-4dde-b67f-d38d8e3ad399 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] [instance: f99567d1-cadf-40c5-b1dc-f86739b2b16c] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:05:51.592018 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-413988f6-eadd-4dde-b67f-d38d8e3ad399 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:05:51.593216 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-413988f6-eadd-4dde-b67f-d38d8e3ad399 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:05:51.597991 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-413988f6-eadd-4dde-b67f-d38d8e3ad399 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:05:51.600279 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-413988f6-eadd-4dde-b67f-d38d8e3ad399 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:05:51.879939 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-413988f6-eadd-4dde-b67f-d38d8e3ad399 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:05:51.891512 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-413988f6-eadd-4dde-b67f-d38d8e3ad399 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:05:51.893670 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-413988f6-eadd-4dde-b67f-d38d8e3ad399 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:05:51.895171 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-413988f6-eadd-4dde-b67f-d38d8e3ad399 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] 10.222.0.43 "GET /compute/v2.1/servers/f99567d1-cadf-40c5-b1dc-f86739b2b16c" status: 200 len: 1723 microversion: 2.20 time: 0.334963 Jun 29 08:05:51.896200 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 156/314] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 29 08:05:51 2022] GET /compute/v2.1/servers/f99567d1-cadf-40c5-b1dc-f86739b2b16c => generated 1723 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:05:51.903817 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-bddbf613-41c6-4647-9cb7-9b07be8b2291 tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:05:51.903817 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-bddbf613-41c6-4647-9cb7-9b07be8b2291 tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] [instance: 4a523b7d-76fc-4f57-9bfe-c9c2b4b0b8c8] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:05:51.910066 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-bddbf613-41c6-4647-9cb7-9b07be8b2291 tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:05:51.910617 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-bddbf613-41c6-4647-9cb7-9b07be8b2291 tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:05:51.911741 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-bddbf613-41c6-4647-9cb7-9b07be8b2291 tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:05:51.912276 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-bddbf613-41c6-4647-9cb7-9b07be8b2291 tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:05:51.942497 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-cf774520-a2eb-476a-9faa-c770bab933da tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4af4eedee24897be2e702ef51873b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab693125979f4bb7b7b3c94061610fe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:05:51.959456 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-cf774520-a2eb-476a-9faa-c770bab933da tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] 10.222.0.43 "GET /compute/v2.1/servers/ca231b38-fd3e-43ba-9cba-1de10a1ffeec" status: 200 len: 1369 microversion: 2.1 time: 0.423100 Jun 29 08:05:51.969972 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 159/315] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:05:51 2022] GET /compute/v2.1/servers/ca231b38-fd3e-43ba-9cba-1de10a1ffeec => generated 1369 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 08:05:52.200045 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-bddbf613-41c6-4647-9cb7-9b07be8b2291 tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6663857e60ca4440a9a620007be4c2c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7afb1bdb06042f4b983631745f32e19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:05:52.219522 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-bddbf613-41c6-4647-9cb7-9b07be8b2291 tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] 10.222.0.43 "GET /compute/v2.1/servers/4a523b7d-76fc-4f57-9bfe-c9c2b4b0b8c8" status: 200 len: 1356 microversion: 2.1 time: 0.321721 Jun 29 08:05:52.236804 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 157/316] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:05:51 2022] GET /compute/v2.1/servers/4a523b7d-76fc-4f57-9bfe-c9c2b4b0b8c8 => generated 1356 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:05:52.915172 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-bdd9a9ee-f554-447d-b586-4c7875fe6ee3 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:05:52.917213 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-bdd9a9ee-f554-447d-b586-4c7875fe6ee3 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] [instance: f99567d1-cadf-40c5-b1dc-f86739b2b16c] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:05:52.924525 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-bdd9a9ee-f554-447d-b586-4c7875fe6ee3 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:05:52.925728 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-bdd9a9ee-f554-447d-b586-4c7875fe6ee3 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:05:52.926101 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-bdd9a9ee-f554-447d-b586-4c7875fe6ee3 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:05:52.926534 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-bdd9a9ee-f554-447d-b586-4c7875fe6ee3 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:05:52.977954 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-3a61cc5d-f664-4f8b-a150-3506da7f5b40 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:05:52.979101 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-3a61cc5d-f664-4f8b-a150-3506da7f5b40 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] [instance: ca231b38-fd3e-43ba-9cba-1de10a1ffeec] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:05:52.986068 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-3a61cc5d-f664-4f8b-a150-3506da7f5b40 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:05:52.987173 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-3a61cc5d-f664-4f8b-a150-3506da7f5b40 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:05:52.988173 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-3a61cc5d-f664-4f8b-a150-3506da7f5b40 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:05:52.988744 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-3a61cc5d-f664-4f8b-a150-3506da7f5b40 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:05:53.108591 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-bdd9a9ee-f554-447d-b586-4c7875fe6ee3 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:05:53.122041 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-bdd9a9ee-f554-447d-b586-4c7875fe6ee3 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:05:53.124371 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-bdd9a9ee-f554-447d-b586-4c7875fe6ee3 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:05:53.125665 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-bdd9a9ee-f554-447d-b586-4c7875fe6ee3 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] 10.222.0.43 "GET /compute/v2.1/servers/f99567d1-cadf-40c5-b1dc-f86739b2b16c" status: 200 len: 1723 microversion: 2.20 time: 0.215121 Jun 29 08:05:53.126548 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 160/317] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 29 08:05:52 2022] GET /compute/v2.1/servers/f99567d1-cadf-40c5-b1dc-f86739b2b16c => generated 1723 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 29 08:05:53.237270 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-3a61cc5d-f664-4f8b-a150-3506da7f5b40 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4af4eedee24897be2e702ef51873b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab693125979f4bb7b7b3c94061610fe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:05:53.245286 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-301799da-64d7-4909-bb9a-bff1fe7eb949 tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:05:53.249982 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-301799da-64d7-4909-bb9a-bff1fe7eb949 tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] [instance: 4a523b7d-76fc-4f57-9bfe-c9c2b4b0b8c8] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:05:53.253138 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-3a61cc5d-f664-4f8b-a150-3506da7f5b40 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] 10.222.0.43 "GET /compute/v2.1/servers/ca231b38-fd3e-43ba-9cba-1de10a1ffeec" status: 200 len: 1369 microversion: 2.1 time: 0.279774 Jun 29 08:05:53.256055 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-301799da-64d7-4909-bb9a-bff1fe7eb949 tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:05:53.256266 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 158/318] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:05:52 2022] GET /compute/v2.1/servers/ca231b38-fd3e-43ba-9cba-1de10a1ffeec => generated 1369 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 08:05:53.256675 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-301799da-64d7-4909-bb9a-bff1fe7eb949 tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:05:53.257595 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-301799da-64d7-4909-bb9a-bff1fe7eb949 tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:05:53.260195 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-301799da-64d7-4909-bb9a-bff1fe7eb949 tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:05:53.433169 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-301799da-64d7-4909-bb9a-bff1fe7eb949 tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6663857e60ca4440a9a620007be4c2c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7afb1bdb06042f4b983631745f32e19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:05:53.445870 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-301799da-64d7-4909-bb9a-bff1fe7eb949 tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] 10.222.0.43 "GET /compute/v2.1/servers/4a523b7d-76fc-4f57-9bfe-c9c2b4b0b8c8" status: 200 len: 1356 microversion: 2.1 time: 0.204767 Jun 29 08:05:53.447964 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 161/319] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:05:53 2022] GET /compute/v2.1/servers/4a523b7d-76fc-4f57-9bfe-c9c2b4b0b8c8 => generated 1356 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 08:05:54.157385 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-17d4e599-67a5-4460-a14d-87facad63786 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:05:54.159040 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-17d4e599-67a5-4460-a14d-87facad63786 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] [instance: f99567d1-cadf-40c5-b1dc-f86739b2b16c] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:05:54.167283 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-17d4e599-67a5-4460-a14d-87facad63786 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:05:54.167718 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-17d4e599-67a5-4460-a14d-87facad63786 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:05:54.168493 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-17d4e599-67a5-4460-a14d-87facad63786 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:05:54.168925 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-17d4e599-67a5-4460-a14d-87facad63786 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:05:54.273419 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-cedeb09b-ab9b-4afa-8f40-51a4ea8dc29f tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:05:54.274768 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-cedeb09b-ab9b-4afa-8f40-51a4ea8dc29f tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] [instance: ca231b38-fd3e-43ba-9cba-1de10a1ffeec] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:05:54.281942 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-cedeb09b-ab9b-4afa-8f40-51a4ea8dc29f tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:05:54.282805 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-cedeb09b-ab9b-4afa-8f40-51a4ea8dc29f tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:05:54.285153 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-cedeb09b-ab9b-4afa-8f40-51a4ea8dc29f tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:05:54.286127 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-cedeb09b-ab9b-4afa-8f40-51a4ea8dc29f tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:05:54.410228 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-17d4e599-67a5-4460-a14d-87facad63786 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:05:54.438595 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-17d4e599-67a5-4460-a14d-87facad63786 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:05:54.442003 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-17d4e599-67a5-4460-a14d-87facad63786 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:05:54.444460 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-17d4e599-67a5-4460-a14d-87facad63786 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] 10.222.0.43 "GET /compute/v2.1/servers/f99567d1-cadf-40c5-b1dc-f86739b2b16c" status: 200 len: 1723 microversion: 2.20 time: 0.291754 Jun 29 08:05:54.461087 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 159/320] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 29 08:05:54 2022] GET /compute/v2.1/servers/f99567d1-cadf-40c5-b1dc-f86739b2b16c => generated 1723 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:05:54.468146 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-ce6afab2-12d5-41e8-895e-6b6fa2f02f2b tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:05:54.469380 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-ce6afab2-12d5-41e8-895e-6b6fa2f02f2b tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] [instance: 4a523b7d-76fc-4f57-9bfe-c9c2b4b0b8c8] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:05:54.493532 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ce6afab2-12d5-41e8-895e-6b6fa2f02f2b tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:05:54.493532 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ce6afab2-12d5-41e8-895e-6b6fa2f02f2b tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:05:54.495806 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ce6afab2-12d5-41e8-895e-6b6fa2f02f2b tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:05:54.496815 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ce6afab2-12d5-41e8-895e-6b6fa2f02f2b tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:05:54.542199 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-cedeb09b-ab9b-4afa-8f40-51a4ea8dc29f tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4af4eedee24897be2e702ef51873b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab693125979f4bb7b7b3c94061610fe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:05:54.563701 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-cedeb09b-ab9b-4afa-8f40-51a4ea8dc29f tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] 10.222.0.43 "GET /compute/v2.1/servers/ca231b38-fd3e-43ba-9cba-1de10a1ffeec" status: 200 len: 1369 microversion: 2.1 time: 0.290732 Jun 29 08:05:54.565586 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 162/321] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:05:54 2022] GET /compute/v2.1/servers/ca231b38-fd3e-43ba-9cba-1de10a1ffeec => generated 1369 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:05:54.743454 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-ce6afab2-12d5-41e8-895e-6b6fa2f02f2b tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6663857e60ca4440a9a620007be4c2c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7afb1bdb06042f4b983631745f32e19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:05:54.757170 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-ce6afab2-12d5-41e8-895e-6b6fa2f02f2b tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] 10.222.0.43 "GET /compute/v2.1/servers/4a523b7d-76fc-4f57-9bfe-c9c2b4b0b8c8" status: 200 len: 1356 microversion: 2.1 time: 0.294119 Jun 29 08:05:54.758269 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 160/322] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:05:54 2022] GET /compute/v2.1/servers/4a523b7d-76fc-4f57-9bfe-c9c2b4b0b8c8 => generated 1356 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 08:05:55.469554 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-7c626fd2-1642-48b1-adb6-e17dbb131118 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:05:55.470233 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-7c626fd2-1642-48b1-adb6-e17dbb131118 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] [instance: f99567d1-cadf-40c5-b1dc-f86739b2b16c] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:05:55.474215 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG dbcounter [-] [117890] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=2 {{(pid=117890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:05:55.480761 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-7c626fd2-1642-48b1-adb6-e17dbb131118 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:05:55.481273 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-7c626fd2-1642-48b1-adb6-e17dbb131118 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:05:55.482199 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-7c626fd2-1642-48b1-adb6-e17dbb131118 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:05:55.482676 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-7c626fd2-1642-48b1-adb6-e17dbb131118 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:05:55.582915 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-626be07d-6231-4a72-ae71-8fd12ff18fbf tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:05:55.584698 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-626be07d-6231-4a72-ae71-8fd12ff18fbf tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] [instance: ca231b38-fd3e-43ba-9cba-1de10a1ffeec] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:05:55.597150 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-626be07d-6231-4a72-ae71-8fd12ff18fbf tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:05:55.597967 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-626be07d-6231-4a72-ae71-8fd12ff18fbf tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:05:55.598769 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-626be07d-6231-4a72-ae71-8fd12ff18fbf tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:05:55.599211 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-626be07d-6231-4a72-ae71-8fd12ff18fbf tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:05:55.690592 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-7c626fd2-1642-48b1-adb6-e17dbb131118 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:05:55.721059 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-7c626fd2-1642-48b1-adb6-e17dbb131118 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:05:55.724566 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-7c626fd2-1642-48b1-adb6-e17dbb131118 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:05:55.727053 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-7c626fd2-1642-48b1-adb6-e17dbb131118 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] 10.222.0.43 "GET /compute/v2.1/servers/f99567d1-cadf-40c5-b1dc-f86739b2b16c" status: 200 len: 1723 microversion: 2.20 time: 0.261123 Jun 29 08:05:55.741388 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 163/323] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 29 08:05:55 2022] GET /compute/v2.1/servers/f99567d1-cadf-40c5-b1dc-f86739b2b16c => generated 1723 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:05:55.796520 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-341b6955-4921-47eb-91fe-bfdb2dd01190 tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:05:55.796520 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-341b6955-4921-47eb-91fe-bfdb2dd01190 tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] [instance: 4a523b7d-76fc-4f57-9bfe-c9c2b4b0b8c8] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:05:55.805099 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-341b6955-4921-47eb-91fe-bfdb2dd01190 tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:05:55.805099 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-341b6955-4921-47eb-91fe-bfdb2dd01190 tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:05:55.805099 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-341b6955-4921-47eb-91fe-bfdb2dd01190 tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:05:55.805099 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-341b6955-4921-47eb-91fe-bfdb2dd01190 tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:05:55.982911 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-626be07d-6231-4a72-ae71-8fd12ff18fbf tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4af4eedee24897be2e702ef51873b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab693125979f4bb7b7b3c94061610fe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:05:55.995461 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-626be07d-6231-4a72-ae71-8fd12ff18fbf tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] 10.222.0.43 "GET /compute/v2.1/servers/ca231b38-fd3e-43ba-9cba-1de10a1ffeec" status: 200 len: 1369 microversion: 2.1 time: 0.418186 Jun 29 08:05:55.997027 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 161/324] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:05:55 2022] GET /compute/v2.1/servers/ca231b38-fd3e-43ba-9cba-1de10a1ffeec => generated 1369 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 08:05:56.150295 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-341b6955-4921-47eb-91fe-bfdb2dd01190 tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6663857e60ca4440a9a620007be4c2c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7afb1bdb06042f4b983631745f32e19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:05:56.163475 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-341b6955-4921-47eb-91fe-bfdb2dd01190 tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] 10.222.0.43 "GET /compute/v2.1/servers/4a523b7d-76fc-4f57-9bfe-c9c2b4b0b8c8" status: 200 len: 1356 microversion: 2.1 time: 0.383162 Jun 29 08:05:56.165079 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 164/325] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:05:55 2022] GET /compute/v2.1/servers/4a523b7d-76fc-4f57-9bfe-c9c2b4b0b8c8 => generated 1356 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 08:05:56.225615 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [req-b5e9c297-0e3e-4de2-8221-15c9ceabc5db req-3f88db29-f65b-42b0-b6c0-cee6c034ede4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f99567d1-cadf-40c5-b1dc-f86739b2b16c", "name": "network-vif-unplugged", "status": "completed", "tag": "dfb8e71b-41e2-4d03-8de7-4f7323f5b53b"}]} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:05:56.238124 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-b5e9c297-0e3e-4de2-8221-15c9ceabc5db req-3f88db29-f65b-42b0-b6c0-cee6c034ede4 service nova] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:05:56.238888 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-b5e9c297-0e3e-4de2-8221-15c9ceabc5db req-3f88db29-f65b-42b0-b6c0-cee6c034ede4 service nova] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:05:56.264564 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.compute.server_external_events [req-b5e9c297-0e3e-4de2-8221-15c9ceabc5db req-3f88db29-f65b-42b0-b6c0-cee6c034ede4 service nova] Creating event network-vif-unplugged:dfb8e71b-41e2-4d03-8de7-4f7323f5b53b for instance f99567d1-cadf-40c5-b1dc-f86739b2b16c on hv-cinder-76810 Jun 29 08:05:56.273070 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [req-b5e9c297-0e3e-4de2-8221-15c9ceabc5db req-3f88db29-f65b-42b0-b6c0-cee6c034ede4 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.050593 Jun 29 08:05:56.274037 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 162/326] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jun 29 08:05:56 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 29 08:05:56.759838 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-d0461bfc-d26c-4df0-9cff-e25e144d6fab tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:05:56.761231 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-d0461bfc-d26c-4df0-9cff-e25e144d6fab tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] [instance: f99567d1-cadf-40c5-b1dc-f86739b2b16c] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:05:56.772562 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-d0461bfc-d26c-4df0-9cff-e25e144d6fab tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:05:56.773373 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-d0461bfc-d26c-4df0-9cff-e25e144d6fab tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:05:56.776336 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-d0461bfc-d26c-4df0-9cff-e25e144d6fab tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:05:56.778264 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-d0461bfc-d26c-4df0-9cff-e25e144d6fab tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:05:56.987375 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-d0461bfc-d26c-4df0-9cff-e25e144d6fab tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:05:56.998868 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-d0461bfc-d26c-4df0-9cff-e25e144d6fab tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:05:57.000681 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-d0461bfc-d26c-4df0-9cff-e25e144d6fab tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:05:57.002856 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-d0461bfc-d26c-4df0-9cff-e25e144d6fab tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] 10.222.0.43 "GET /compute/v2.1/servers/f99567d1-cadf-40c5-b1dc-f86739b2b16c" status: 200 len: 1723 microversion: 2.20 time: 0.247619 Jun 29 08:05:57.004301 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 165/327] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 29 08:05:56 2022] GET /compute/v2.1/servers/f99567d1-cadf-40c5-b1dc-f86739b2b16c => generated 1723 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:05:57.027160 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-24c5d937-20c2-4e65-8f6a-37da3e42b157 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:05:57.027948 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-24c5d937-20c2-4e65-8f6a-37da3e42b157 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] [instance: ca231b38-fd3e-43ba-9cba-1de10a1ffeec] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:05:57.037015 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-24c5d937-20c2-4e65-8f6a-37da3e42b157 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:05:57.037837 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-24c5d937-20c2-4e65-8f6a-37da3e42b157 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:05:57.038949 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-24c5d937-20c2-4e65-8f6a-37da3e42b157 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:05:57.039472 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-24c5d937-20c2-4e65-8f6a-37da3e42b157 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:05:57.183199 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-89fea968-f96b-48b3-ab90-e899dd574d04 tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:05:57.184121 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-89fea968-f96b-48b3-ab90-e899dd574d04 tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] [instance: 4a523b7d-76fc-4f57-9bfe-c9c2b4b0b8c8] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:05:57.192357 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-89fea968-f96b-48b3-ab90-e899dd574d04 tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:05:57.192970 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-89fea968-f96b-48b3-ab90-e899dd574d04 tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:05:57.193785 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-89fea968-f96b-48b3-ab90-e899dd574d04 tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:05:57.194224 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-89fea968-f96b-48b3-ab90-e899dd574d04 tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:05:57.239316 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-24c5d937-20c2-4e65-8f6a-37da3e42b157 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4af4eedee24897be2e702ef51873b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab693125979f4bb7b7b3c94061610fe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:05:57.247491 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-24c5d937-20c2-4e65-8f6a-37da3e42b157 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] 10.222.0.43 "GET /compute/v2.1/servers/ca231b38-fd3e-43ba-9cba-1de10a1ffeec" status: 200 len: 1369 microversion: 2.1 time: 0.225605 Jun 29 08:05:57.248097 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 163/328] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:05:57 2022] GET /compute/v2.1/servers/ca231b38-fd3e-43ba-9cba-1de10a1ffeec => generated 1369 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:05:57.414007 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-89fea968-f96b-48b3-ab90-e899dd574d04 tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6663857e60ca4440a9a620007be4c2c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7afb1bdb06042f4b983631745f32e19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:05:57.423257 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-89fea968-f96b-48b3-ab90-e899dd574d04 tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] 10.222.0.43 "GET /compute/v2.1/servers/4a523b7d-76fc-4f57-9bfe-c9c2b4b0b8c8" status: 200 len: 1356 microversion: 2.1 time: 0.245095 Jun 29 08:05:57.424929 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 166/329] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:05:57 2022] GET /compute/v2.1/servers/4a523b7d-76fc-4f57-9bfe-c9c2b4b0b8c8 => generated 1356 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:05:58.024106 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-01c294f2-f01a-4a7e-8a2f-209eead99599 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:05:58.025479 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-01c294f2-f01a-4a7e-8a2f-209eead99599 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] [instance: f99567d1-cadf-40c5-b1dc-f86739b2b16c] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:05:58.037530 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-01c294f2-f01a-4a7e-8a2f-209eead99599 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:05:58.039445 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-01c294f2-f01a-4a7e-8a2f-209eead99599 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:05:58.040836 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-01c294f2-f01a-4a7e-8a2f-209eead99599 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:05:58.041622 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-01c294f2-f01a-4a7e-8a2f-209eead99599 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:05:58.270439 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-c9426002-1227-4710-aa1e-5ba87a601d96 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:05:58.271575 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-c9426002-1227-4710-aa1e-5ba87a601d96 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] [instance: ca231b38-fd3e-43ba-9cba-1de10a1ffeec] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:05:58.284494 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-01c294f2-f01a-4a7e-8a2f-209eead99599 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:05:58.289407 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-c9426002-1227-4710-aa1e-5ba87a601d96 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:05:58.290180 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-c9426002-1227-4710-aa1e-5ba87a601d96 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:05:58.291175 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-c9426002-1227-4710-aa1e-5ba87a601d96 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:05:58.291791 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-c9426002-1227-4710-aa1e-5ba87a601d96 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:05:58.294330 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-01c294f2-f01a-4a7e-8a2f-209eead99599 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:05:58.296045 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-01c294f2-f01a-4a7e-8a2f-209eead99599 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:05:58.297428 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-01c294f2-f01a-4a7e-8a2f-209eead99599 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] 10.222.0.43 "GET /compute/v2.1/servers/f99567d1-cadf-40c5-b1dc-f86739b2b16c" status: 200 len: 1723 microversion: 2.20 time: 0.278451 Jun 29 08:05:58.314208 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 164/330] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 29 08:05:58 2022] GET /compute/v2.1/servers/f99567d1-cadf-40c5-b1dc-f86739b2b16c => generated 1723 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 29 08:05:58.442879 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-e8b3a50c-9d7f-42e5-bb09-4a57d5fda756 tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:05:58.443544 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-e8b3a50c-9d7f-42e5-bb09-4a57d5fda756 tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] [instance: 4a523b7d-76fc-4f57-9bfe-c9c2b4b0b8c8] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:05:58.454882 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e8b3a50c-9d7f-42e5-bb09-4a57d5fda756 tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:05:58.456184 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e8b3a50c-9d7f-42e5-bb09-4a57d5fda756 tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:05:58.457625 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e8b3a50c-9d7f-42e5-bb09-4a57d5fda756 tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:05:58.458250 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e8b3a50c-9d7f-42e5-bb09-4a57d5fda756 tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:05:58.477020 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-c9426002-1227-4710-aa1e-5ba87a601d96 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4af4eedee24897be2e702ef51873b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab693125979f4bb7b7b3c94061610fe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:05:58.516118 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-c9426002-1227-4710-aa1e-5ba87a601d96 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] 10.222.0.43 "GET /compute/v2.1/servers/ca231b38-fd3e-43ba-9cba-1de10a1ffeec" status: 200 len: 1369 microversion: 2.1 time: 0.253741 Jun 29 08:05:58.526631 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 167/331] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:05:58 2022] GET /compute/v2.1/servers/ca231b38-fd3e-43ba-9cba-1de10a1ffeec => generated 1369 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:05:58.705108 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-e8b3a50c-9d7f-42e5-bb09-4a57d5fda756 tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6663857e60ca4440a9a620007be4c2c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7afb1bdb06042f4b983631745f32e19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:05:58.720202 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-e8b3a50c-9d7f-42e5-bb09-4a57d5fda756 tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] 10.222.0.43 "GET /compute/v2.1/servers/4a523b7d-76fc-4f57-9bfe-c9c2b4b0b8c8" status: 200 len: 1356 microversion: 2.1 time: 0.281960 Jun 29 08:05:58.721355 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 165/332] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:05:58 2022] GET /compute/v2.1/servers/4a523b7d-76fc-4f57-9bfe-c9c2b4b0b8c8 => generated 1356 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 08:05:59.323287 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-b6cdc6eb-8a6a-400c-a923-ec61cd6a8db3 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:05:59.324198 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-b6cdc6eb-8a6a-400c-a923-ec61cd6a8db3 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] [instance: f99567d1-cadf-40c5-b1dc-f86739b2b16c] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:05:59.335139 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-b6cdc6eb-8a6a-400c-a923-ec61cd6a8db3 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:05:59.335897 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-b6cdc6eb-8a6a-400c-a923-ec61cd6a8db3 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:05:59.337529 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-b6cdc6eb-8a6a-400c-a923-ec61cd6a8db3 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:05:59.338693 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-b6cdc6eb-8a6a-400c-a923-ec61cd6a8db3 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:05:59.347357 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG dbcounter [-] [117890] Writing DB stats nova_cell1:SELECT=100 {{(pid=117890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:05:59.536949 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-9fe4899a-ad60-4e82-b462-b97af5ebd97a tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:05:59.538391 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-9fe4899a-ad60-4e82-b462-b97af5ebd97a tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] [instance: ca231b38-fd3e-43ba-9cba-1de10a1ffeec] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:05:59.546701 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-9fe4899a-ad60-4e82-b462-b97af5ebd97a tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:05:59.547895 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-9fe4899a-ad60-4e82-b462-b97af5ebd97a tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:05:59.550131 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-9fe4899a-ad60-4e82-b462-b97af5ebd97a tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:05:59.551550 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-9fe4899a-ad60-4e82-b462-b97af5ebd97a tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:05:59.619667 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-b6cdc6eb-8a6a-400c-a923-ec61cd6a8db3 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:05:59.636774 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-b6cdc6eb-8a6a-400c-a923-ec61cd6a8db3 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:05:59.640351 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-b6cdc6eb-8a6a-400c-a923-ec61cd6a8db3 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:05:59.646042 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-b6cdc6eb-8a6a-400c-a923-ec61cd6a8db3 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] 10.222.0.43 "GET /compute/v2.1/servers/f99567d1-cadf-40c5-b1dc-f86739b2b16c" status: 200 len: 1723 microversion: 2.20 time: 0.327000 Jun 29 08:05:59.647586 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 168/333] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 29 08:05:59 2022] GET /compute/v2.1/servers/f99567d1-cadf-40c5-b1dc-f86739b2b16c => generated 1723 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:05:59.750689 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-016e8510-8ae3-4d92-a73d-e238b5c3af5f tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:05:59.753593 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-016e8510-8ae3-4d92-a73d-e238b5c3af5f tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] [instance: 4a523b7d-76fc-4f57-9bfe-c9c2b4b0b8c8] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:05:59.769890 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-016e8510-8ae3-4d92-a73d-e238b5c3af5f tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:05:59.771070 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-016e8510-8ae3-4d92-a73d-e238b5c3af5f tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:05:59.772555 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-016e8510-8ae3-4d92-a73d-e238b5c3af5f tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:05:59.773457 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-016e8510-8ae3-4d92-a73d-e238b5c3af5f tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:05:59.851085 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-9fe4899a-ad60-4e82-b462-b97af5ebd97a tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4af4eedee24897be2e702ef51873b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab693125979f4bb7b7b3c94061610fe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:05:59.855104 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_cell1:SELECT=100 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:05:59.892317 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-9fe4899a-ad60-4e82-b462-b97af5ebd97a tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] 10.222.0.43 "GET /compute/v2.1/servers/ca231b38-fd3e-43ba-9cba-1de10a1ffeec" status: 200 len: 1369 microversion: 2.1 time: 0.349378 Jun 29 08:05:59.909918 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 166/334] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:05:59 2022] GET /compute/v2.1/servers/ca231b38-fd3e-43ba-9cba-1de10a1ffeec => generated 1369 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:06:00.166141 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-016e8510-8ae3-4d92-a73d-e238b5c3af5f tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6663857e60ca4440a9a620007be4c2c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7afb1bdb06042f4b983631745f32e19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:06:00.177484 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-016e8510-8ae3-4d92-a73d-e238b5c3af5f tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] 10.222.0.43 "GET /compute/v2.1/servers/4a523b7d-76fc-4f57-9bfe-c9c2b4b0b8c8" status: 200 len: 1356 microversion: 2.1 time: 0.436054 Jun 29 08:06:00.178087 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 169/335] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:05:59 2022] GET /compute/v2.1/servers/4a523b7d-76fc-4f57-9bfe-c9c2b4b0b8c8 => generated 1356 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 08:06:00.643988 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [req-975048ea-2ffe-44ff-8980-9b34d2c26c5c req-05a37b71-103e-499a-9dac-d4a26b3661e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca231b38-fd3e-43ba-9cba-1de10a1ffeec", "name": "network-vif-plugged", "status": "completed", "tag": "5a5ce414-6f70-43b5-a7cc-7340f679070a"}]} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:06:00.681098 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-975048ea-2ffe-44ff-8980-9b34d2c26c5c req-05a37b71-103e-499a-9dac-d4a26b3661e3 service nova] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:00.686490 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-975048ea-2ffe-44ff-8980-9b34d2c26c5c req-05a37b71-103e-499a-9dac-d4a26b3661e3 service nova] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:00.691488 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-5d3a50f8-3821-453c-9845-12fc317bc124 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:06:00.695794 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-5d3a50f8-3821-453c-9845-12fc317bc124 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] [instance: f99567d1-cadf-40c5-b1dc-f86739b2b16c] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:06:00.718348 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-5d3a50f8-3821-453c-9845-12fc317bc124 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:00.719928 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-5d3a50f8-3821-453c-9845-12fc317bc124 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:00.722175 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-5d3a50f8-3821-453c-9845-12fc317bc124 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:00.723194 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-5d3a50f8-3821-453c-9845-12fc317bc124 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:00.751165 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.compute.server_external_events [req-975048ea-2ffe-44ff-8980-9b34d2c26c5c req-05a37b71-103e-499a-9dac-d4a26b3661e3 service nova] Creating event network-vif-plugged:5a5ce414-6f70-43b5-a7cc-7340f679070a for instance ca231b38-fd3e-43ba-9cba-1de10a1ffeec on hv-cinder-76810 Jun 29 08:06:00.764254 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [req-975048ea-2ffe-44ff-8980-9b34d2c26c5c req-05a37b71-103e-499a-9dac-d4a26b3661e3 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.127657 Jun 29 08:06:00.765525 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 167/336] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jun 29 08:06:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:06:00.922111 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-b6d17d4e-6eab-4d26-8ea4-3d9cc98ec169 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:06:00.923026 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-b6d17d4e-6eab-4d26-8ea4-3d9cc98ec169 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] [instance: ca231b38-fd3e-43ba-9cba-1de10a1ffeec] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:06:00.940635 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-b6d17d4e-6eab-4d26-8ea4-3d9cc98ec169 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:00.941830 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-b6d17d4e-6eab-4d26-8ea4-3d9cc98ec169 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:00.944700 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-b6d17d4e-6eab-4d26-8ea4-3d9cc98ec169 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:00.945832 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-b6d17d4e-6eab-4d26-8ea4-3d9cc98ec169 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:01.067553 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-5d3a50f8-3821-453c-9845-12fc317bc124 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:06:01.082804 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-5d3a50f8-3821-453c-9845-12fc317bc124 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:06:01.086332 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-5d3a50f8-3821-453c-9845-12fc317bc124 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:06:01.088595 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-5d3a50f8-3821-453c-9845-12fc317bc124 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] 10.222.0.43 "GET /compute/v2.1/servers/f99567d1-cadf-40c5-b1dc-f86739b2b16c" status: 200 len: 1723 microversion: 2.20 time: 0.416280 Jun 29 08:06:01.091766 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 170/337] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 29 08:06:00 2022] GET /compute/v2.1/servers/f99567d1-cadf-40c5-b1dc-f86739b2b16c => generated 1723 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:06:01.141603 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-b6d17d4e-6eab-4d26-8ea4-3d9cc98ec169 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4af4eedee24897be2e702ef51873b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab693125979f4bb7b7b3c94061610fe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:06:01.156719 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-b6d17d4e-6eab-4d26-8ea4-3d9cc98ec169 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] 10.222.0.43 "GET /compute/v2.1/servers/ca231b38-fd3e-43ba-9cba-1de10a1ffeec" status: 200 len: 1369 microversion: 2.1 time: 0.239252 Jun 29 08:06:01.157805 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 168/338] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:06:00 2022] GET /compute/v2.1/servers/ca231b38-fd3e-43ba-9cba-1de10a1ffeec => generated 1369 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:06:01.203294 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-ded35eaa-2fbc-481b-a18b-fa91a15c4ab9 tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:06:01.203920 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-ded35eaa-2fbc-481b-a18b-fa91a15c4ab9 tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] [instance: 4a523b7d-76fc-4f57-9bfe-c9c2b4b0b8c8] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:06:01.211065 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-ded35eaa-2fbc-481b-a18b-fa91a15c4ab9 tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:01.211630 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-ded35eaa-2fbc-481b-a18b-fa91a15c4ab9 tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:01.212572 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-ded35eaa-2fbc-481b-a18b-fa91a15c4ab9 tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:01.213204 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-ded35eaa-2fbc-481b-a18b-fa91a15c4ab9 tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:01.359288 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-ded35eaa-2fbc-481b-a18b-fa91a15c4ab9 tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6663857e60ca4440a9a620007be4c2c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7afb1bdb06042f4b983631745f32e19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:06:01.371302 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-ded35eaa-2fbc-481b-a18b-fa91a15c4ab9 tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] 10.222.0.43 "GET /compute/v2.1/servers/4a523b7d-76fc-4f57-9bfe-c9c2b4b0b8c8" status: 200 len: 1356 microversion: 2.1 time: 0.171932 Jun 29 08:06:01.371904 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 171/339] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:06:01 2022] GET /compute/v2.1/servers/4a523b7d-76fc-4f57-9bfe-c9c2b4b0b8c8 => generated 1356 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 08:06:02.123338 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-b3c2bf0f-6dc4-4f59-8131-5307421ca844 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:06:02.124476 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-b3c2bf0f-6dc4-4f59-8131-5307421ca844 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] [instance: f99567d1-cadf-40c5-b1dc-f86739b2b16c] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:06:02.131277 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=3 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:06:02.140006 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-b3c2bf0f-6dc4-4f59-8131-5307421ca844 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:02.140817 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-b3c2bf0f-6dc4-4f59-8131-5307421ca844 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:02.142350 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-b3c2bf0f-6dc4-4f59-8131-5307421ca844 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:02.144193 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-b3c2bf0f-6dc4-4f59-8131-5307421ca844 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:02.177770 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-3ebce0a1-7d12-434a-a518-3446777e1487 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:06:02.179334 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-3ebce0a1-7d12-434a-a518-3446777e1487 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] [instance: ca231b38-fd3e-43ba-9cba-1de10a1ffeec] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:06:02.187078 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-3ebce0a1-7d12-434a-a518-3446777e1487 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:02.187714 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-3ebce0a1-7d12-434a-a518-3446777e1487 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:02.188649 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-3ebce0a1-7d12-434a-a518-3446777e1487 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:02.189232 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-3ebce0a1-7d12-434a-a518-3446777e1487 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:02.404878 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-3ebce0a1-7d12-434a-a518-3446777e1487 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4af4eedee24897be2e702ef51873b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab693125979f4bb7b7b3c94061610fe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:06:02.418469 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-3ebce0a1-7d12-434a-a518-3446777e1487 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] 10.222.0.43 "GET /compute/v2.1/servers/ca231b38-fd3e-43ba-9cba-1de10a1ffeec" status: 200 len: 1369 microversion: 2.1 time: 0.246283 Jun 29 08:06:02.419323 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 172/340] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:06:02 2022] GET /compute/v2.1/servers/ca231b38-fd3e-43ba-9cba-1de10a1ffeec => generated 1369 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 08:06:02.429083 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-b2457ece-e112-4df7-89a8-3aba617c148c tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:06:02.430204 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-b2457ece-e112-4df7-89a8-3aba617c148c tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] [instance: 4a523b7d-76fc-4f57-9bfe-c9c2b4b0b8c8] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:06:02.440660 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-b2457ece-e112-4df7-89a8-3aba617c148c tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:02.441480 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-b2457ece-e112-4df7-89a8-3aba617c148c tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:02.442412 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-b2457ece-e112-4df7-89a8-3aba617c148c tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:02.442955 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-b2457ece-e112-4df7-89a8-3aba617c148c tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:02.676303 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-b2457ece-e112-4df7-89a8-3aba617c148c tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6663857e60ca4440a9a620007be4c2c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7afb1bdb06042f4b983631745f32e19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:06:02.696524 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-b2457ece-e112-4df7-89a8-3aba617c148c tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] 10.222.0.43 "GET /compute/v2.1/servers/4a523b7d-76fc-4f57-9bfe-c9c2b4b0b8c8" status: 200 len: 1356 microversion: 2.1 time: 0.275027 Jun 29 08:06:02.697755 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 173/341] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:06:02 2022] GET /compute/v2.1/servers/4a523b7d-76fc-4f57-9bfe-c9c2b4b0b8c8 => generated 1356 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:06:02.708297 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-c82d9ea4-f715-46b9-8cc8-5ee81059cb7e tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:06:02.709606 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-c82d9ea4-f715-46b9-8cc8-5ee81059cb7e tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] [instance: 2e99307a-e437-4e8d-821c-319cc555e209] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:06:02.733019 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-c82d9ea4-f715-46b9-8cc8-5ee81059cb7e tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:02.733492 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-c82d9ea4-f715-46b9-8cc8-5ee81059cb7e tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:02.734304 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-c82d9ea4-f715-46b9-8cc8-5ee81059cb7e tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:02.734741 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-c82d9ea4-f715-46b9-8cc8-5ee81059cb7e tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:02.801604 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-b3c2bf0f-6dc4-4f59-8131-5307421ca844 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:06:02.817959 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-b3c2bf0f-6dc4-4f59-8131-5307421ca844 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:06:02.821870 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-b3c2bf0f-6dc4-4f59-8131-5307421ca844 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:06:02.824386 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-b3c2bf0f-6dc4-4f59-8131-5307421ca844 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] 10.222.0.43 "GET /compute/v2.1/servers/f99567d1-cadf-40c5-b1dc-f86739b2b16c" status: 200 len: 1723 microversion: 2.20 time: 0.709204 Jun 29 08:06:02.832176 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 169/342] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 29 08:06:02 2022] GET /compute/v2.1/servers/f99567d1-cadf-40c5-b1dc-f86739b2b16c => generated 1723 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:06:02.843824 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [req-406b43ff-db6d-423a-b7ea-fd9062923caf req-d0487d47-72ec-4a5f-946c-0bbae7714cb6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a523b7d-76fc-4f57-9bfe-c9c2b4b0b8c8", "tag": "1315c7c2-f10d-4890-8b5e-93890c37db42"}]} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:06:02.853451 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-406b43ff-db6d-423a-b7ea-fd9062923caf req-d0487d47-72ec-4a5f-946c-0bbae7714cb6 service nova] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:02.854007 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-406b43ff-db6d-423a-b7ea-fd9062923caf req-d0487d47-72ec-4a5f-946c-0bbae7714cb6 service nova] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:02.866944 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.compute.server_external_events [req-406b43ff-db6d-423a-b7ea-fd9062923caf req-d0487d47-72ec-4a5f-946c-0bbae7714cb6 service nova] Creating event network-changed:1315c7c2-f10d-4890-8b5e-93890c37db42 for instance 4a523b7d-76fc-4f57-9bfe-c9c2b4b0b8c8 on hv-cinder-76810 Jun 29 08:06:02.872004 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [req-406b43ff-db6d-423a-b7ea-fd9062923caf req-d0487d47-72ec-4a5f-946c-0bbae7714cb6 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040214 Jun 29 08:06:02.872734 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 170/343] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jun 29 08:06:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:06:02.913553 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.objects.instance [None req-c82d9ea4-f715-46b9-8cc8-5ee81059cb7e tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Lazy-loading 'services' on Instance uuid 2e99307a-e437-4e8d-821c-319cc555e209 {{(pid=117890) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 29 08:06:03.056264 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-c82d9ea4-f715-46b9-8cc8-5ee81059cb7e tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] 10.222.0.43 "DELETE /compute/v2.1/servers/2e99307a-e437-4e8d-821c-319cc555e209/os-volume_attachments/9655d8dc-cf59-424b-93bd-f866886b00b1" status: 202 len: 0 microversion: 2.1 time: 0.356298 Jun 29 08:06:03.057698 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 174/344] 10.222.0.43 () {58 vars in 1415 bytes} [Wed Jun 29 08:06:02 2022] DELETE /compute/v2.1/servers/2e99307a-e437-4e8d-821c-319cc555e209/os-volume_attachments/9655d8dc-cf59-424b-93bd-f866886b00b1 => generated 0 bytes in 359 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 29 08:06:03.445844 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-f96c3a84-3736-4996-9861-313397649468 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:06:03.446576 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-f96c3a84-3736-4996-9861-313397649468 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] [instance: ca231b38-fd3e-43ba-9cba-1de10a1ffeec] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:06:03.453182 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-f96c3a84-3736-4996-9861-313397649468 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:03.453629 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-f96c3a84-3736-4996-9861-313397649468 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:03.454411 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-f96c3a84-3736-4996-9861-313397649468 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:03.454849 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-f96c3a84-3736-4996-9861-313397649468 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:03.613757 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-f96c3a84-3736-4996-9861-313397649468 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4af4eedee24897be2e702ef51873b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab693125979f4bb7b7b3c94061610fe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:06:03.626127 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-f96c3a84-3736-4996-9861-313397649468 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] 10.222.0.43 "GET /compute/v2.1/servers/ca231b38-fd3e-43ba-9cba-1de10a1ffeec" status: 200 len: 1369 microversion: 2.1 time: 0.184649 Jun 29 08:06:03.627506 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 171/345] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:06:03 2022] GET /compute/v2.1/servers/ca231b38-fd3e-43ba-9cba-1de10a1ffeec => generated 1369 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:06:03.726062 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-2c93fb2c-282c-4ad2-a5a9-5628c02173a4 tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:06:03.726901 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-2c93fb2c-282c-4ad2-a5a9-5628c02173a4 tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] [instance: 4a523b7d-76fc-4f57-9bfe-c9c2b4b0b8c8] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:06:03.740030 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-2c93fb2c-282c-4ad2-a5a9-5628c02173a4 tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:03.740909 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-2c93fb2c-282c-4ad2-a5a9-5628c02173a4 tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:03.742160 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-2c93fb2c-282c-4ad2-a5a9-5628c02173a4 tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:03.742981 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-2c93fb2c-282c-4ad2-a5a9-5628c02173a4 tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:03.856071 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-65b778f5-dd57-4ffc-9cfc-0401c5ccfa36 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:06:03.857457 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-65b778f5-dd57-4ffc-9cfc-0401c5ccfa36 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] [instance: f99567d1-cadf-40c5-b1dc-f86739b2b16c] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:06:03.869910 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-65b778f5-dd57-4ffc-9cfc-0401c5ccfa36 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:03.870381 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-65b778f5-dd57-4ffc-9cfc-0401c5ccfa36 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:03.871181 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-65b778f5-dd57-4ffc-9cfc-0401c5ccfa36 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:03.871936 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-65b778f5-dd57-4ffc-9cfc-0401c5ccfa36 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:03.944814 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-2c93fb2c-282c-4ad2-a5a9-5628c02173a4 tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6663857e60ca4440a9a620007be4c2c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7afb1bdb06042f4b983631745f32e19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:06:03.953130 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-2c93fb2c-282c-4ad2-a5a9-5628c02173a4 tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] 10.222.0.43 "GET /compute/v2.1/servers/4a523b7d-76fc-4f57-9bfe-c9c2b4b0b8c8" status: 200 len: 1356 microversion: 2.1 time: 0.240582 Jun 29 08:06:03.953722 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 175/346] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:06:03 2022] GET /compute/v2.1/servers/4a523b7d-76fc-4f57-9bfe-c9c2b4b0b8c8 => generated 1356 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:06:04.051803 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-65b778f5-dd57-4ffc-9cfc-0401c5ccfa36 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:06:04.060833 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-65b778f5-dd57-4ffc-9cfc-0401c5ccfa36 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:06:04.062517 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-65b778f5-dd57-4ffc-9cfc-0401c5ccfa36 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:06:04.063798 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-65b778f5-dd57-4ffc-9cfc-0401c5ccfa36 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] 10.222.0.43 "GET /compute/v2.1/servers/f99567d1-cadf-40c5-b1dc-f86739b2b16c" status: 200 len: 1723 microversion: 2.20 time: 0.215857 Jun 29 08:06:04.064387 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 172/347] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 29 08:06:03 2022] GET /compute/v2.1/servers/f99567d1-cadf-40c5-b1dc-f86739b2b16c => generated 1723 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:06:04.648265 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-c0b8df18-7faa-46a8-81dd-96f4e8e41617 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:06:04.649330 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-c0b8df18-7faa-46a8-81dd-96f4e8e41617 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] [instance: ca231b38-fd3e-43ba-9cba-1de10a1ffeec] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:06:04.657715 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-c0b8df18-7faa-46a8-81dd-96f4e8e41617 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:04.658171 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-c0b8df18-7faa-46a8-81dd-96f4e8e41617 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:04.659025 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-c0b8df18-7faa-46a8-81dd-96f4e8e41617 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:04.659479 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-c0b8df18-7faa-46a8-81dd-96f4e8e41617 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:04.820015 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-c0b8df18-7faa-46a8-81dd-96f4e8e41617 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4af4eedee24897be2e702ef51873b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab693125979f4bb7b7b3c94061610fe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:06:04.827598 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-c0b8df18-7faa-46a8-81dd-96f4e8e41617 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] 10.222.0.43 "GET /compute/v2.1/servers/ca231b38-fd3e-43ba-9cba-1de10a1ffeec" status: 200 len: 1369 microversion: 2.1 time: 0.187160 Jun 29 08:06:04.828187 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 176/348] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:06:04 2022] GET /compute/v2.1/servers/ca231b38-fd3e-43ba-9cba-1de10a1ffeec => generated 1369 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:06:04.976255 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-3876e427-8dc2-44a9-9c59-c8c39a0691d2 tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:06:04.976844 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-3876e427-8dc2-44a9-9c59-c8c39a0691d2 tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] [instance: 4a523b7d-76fc-4f57-9bfe-c9c2b4b0b8c8] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:06:04.984113 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-3876e427-8dc2-44a9-9c59-c8c39a0691d2 tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:04.984566 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-3876e427-8dc2-44a9-9c59-c8c39a0691d2 tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:04.985402 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-3876e427-8dc2-44a9-9c59-c8c39a0691d2 tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:04.985850 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-3876e427-8dc2-44a9-9c59-c8c39a0691d2 tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:05.082106 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-da030ddf-8ff3-44fa-85a3-e19e5e91decb tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:06:05.082717 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-da030ddf-8ff3-44fa-85a3-e19e5e91decb tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] [instance: f99567d1-cadf-40c5-b1dc-f86739b2b16c] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:06:05.089399 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-da030ddf-8ff3-44fa-85a3-e19e5e91decb tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:05.089869 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-da030ddf-8ff3-44fa-85a3-e19e5e91decb tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:05.090694 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-da030ddf-8ff3-44fa-85a3-e19e5e91decb tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:05.091147 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-da030ddf-8ff3-44fa-85a3-e19e5e91decb tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:05.140185 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-3876e427-8dc2-44a9-9c59-c8c39a0691d2 tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6663857e60ca4440a9a620007be4c2c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7afb1bdb06042f4b983631745f32e19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:06:05.149026 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-3876e427-8dc2-44a9-9c59-c8c39a0691d2 tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] 10.222.0.43 "GET /compute/v2.1/servers/4a523b7d-76fc-4f57-9bfe-c9c2b4b0b8c8" status: 200 len: 1356 microversion: 2.1 time: 0.176973 Jun 29 08:06:05.149610 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 173/349] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:06:04 2022] GET /compute/v2.1/servers/4a523b7d-76fc-4f57-9bfe-c9c2b4b0b8c8 => generated 1356 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:06:05.265701 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-da030ddf-8ff3-44fa-85a3-e19e5e91decb tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:06:05.275318 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-da030ddf-8ff3-44fa-85a3-e19e5e91decb tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:06:05.276810 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-da030ddf-8ff3-44fa-85a3-e19e5e91decb tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:06:05.278018 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-da030ddf-8ff3-44fa-85a3-e19e5e91decb tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] 10.222.0.43 "GET /compute/v2.1/servers/f99567d1-cadf-40c5-b1dc-f86739b2b16c" status: 200 len: 1723 microversion: 2.20 time: 0.200430 Jun 29 08:06:05.278575 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 177/350] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 29 08:06:05 2022] GET /compute/v2.1/servers/f99567d1-cadf-40c5-b1dc-f86739b2b16c => generated 1723 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 29 08:06:05.845200 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-43039d4e-eff3-4acb-b6ad-852343abeb5a tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:06:05.846800 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-43039d4e-eff3-4acb-b6ad-852343abeb5a tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] [instance: ca231b38-fd3e-43ba-9cba-1de10a1ffeec] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:06:05.856755 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-43039d4e-eff3-4acb-b6ad-852343abeb5a tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:05.858506 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-43039d4e-eff3-4acb-b6ad-852343abeb5a tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:05.859774 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-43039d4e-eff3-4acb-b6ad-852343abeb5a tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:05.860677 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-43039d4e-eff3-4acb-b6ad-852343abeb5a tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:06.108531 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-43039d4e-eff3-4acb-b6ad-852343abeb5a tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4af4eedee24897be2e702ef51873b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab693125979f4bb7b7b3c94061610fe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:06:06.116398 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-43039d4e-eff3-4acb-b6ad-852343abeb5a tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] 10.222.0.43 "GET /compute/v2.1/servers/ca231b38-fd3e-43ba-9cba-1de10a1ffeec" status: 200 len: 1369 microversion: 2.1 time: 0.276541 Jun 29 08:06:06.117008 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 174/351] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:06:05 2022] GET /compute/v2.1/servers/ca231b38-fd3e-43ba-9cba-1de10a1ffeec => generated 1369 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:06:06.165528 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-5ab92a4e-bb93-4956-aea9-f01a3d580419 tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:06:06.166165 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-5ab92a4e-bb93-4956-aea9-f01a3d580419 tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] [instance: 4a523b7d-76fc-4f57-9bfe-c9c2b4b0b8c8] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:06:06.173595 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-5ab92a4e-bb93-4956-aea9-f01a3d580419 tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:06.174329 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-5ab92a4e-bb93-4956-aea9-f01a3d580419 tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:06.175258 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-5ab92a4e-bb93-4956-aea9-f01a3d580419 tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:06.175991 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-5ab92a4e-bb93-4956-aea9-f01a3d580419 tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:06.302014 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-4caa011b-1b30-4f34-b445-376e91c7f94e tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:06:06.302997 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-4caa011b-1b30-4f34-b445-376e91c7f94e tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] [instance: f99567d1-cadf-40c5-b1dc-f86739b2b16c] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:06:06.311492 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-4caa011b-1b30-4f34-b445-376e91c7f94e tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:06.311944 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-4caa011b-1b30-4f34-b445-376e91c7f94e tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:06.312738 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-4caa011b-1b30-4f34-b445-376e91c7f94e tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:06.313210 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-4caa011b-1b30-4f34-b445-376e91c7f94e tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:06.340626 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-5ab92a4e-bb93-4956-aea9-f01a3d580419 tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6663857e60ca4440a9a620007be4c2c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7afb1bdb06042f4b983631745f32e19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:06:06.348527 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-5ab92a4e-bb93-4956-aea9-f01a3d580419 tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] 10.222.0.43 "GET /compute/v2.1/servers/4a523b7d-76fc-4f57-9bfe-c9c2b4b0b8c8" status: 200 len: 1356 microversion: 2.1 time: 0.186738 Jun 29 08:06:06.349241 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 178/352] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:06:06 2022] GET /compute/v2.1/servers/4a523b7d-76fc-4f57-9bfe-c9c2b4b0b8c8 => generated 1356 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:06:06.471748 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-4caa011b-1b30-4f34-b445-376e91c7f94e tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:06:06.480076 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-4caa011b-1b30-4f34-b445-376e91c7f94e tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:06:06.481654 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-4caa011b-1b30-4f34-b445-376e91c7f94e tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:06:06.482845 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-4caa011b-1b30-4f34-b445-376e91c7f94e tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] 10.222.0.43 "GET /compute/v2.1/servers/f99567d1-cadf-40c5-b1dc-f86739b2b16c" status: 200 len: 1723 microversion: 2.20 time: 0.188127 Jun 29 08:06:06.483486 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 175/353] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 29 08:06:06 2022] GET /compute/v2.1/servers/f99567d1-cadf-40c5-b1dc-f86739b2b16c => generated 1723 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:06:07.137668 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-13bff4b3-55ff-4db7-8b69-9bab5c308f16 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:06:07.138279 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-13bff4b3-55ff-4db7-8b69-9bab5c308f16 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] [instance: ca231b38-fd3e-43ba-9cba-1de10a1ffeec] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:06:07.148626 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-13bff4b3-55ff-4db7-8b69-9bab5c308f16 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:07.149282 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-13bff4b3-55ff-4db7-8b69-9bab5c308f16 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:07.150568 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-13bff4b3-55ff-4db7-8b69-9bab5c308f16 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:07.151309 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-13bff4b3-55ff-4db7-8b69-9bab5c308f16 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:07.366258 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-13bff4b3-55ff-4db7-8b69-9bab5c308f16 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4af4eedee24897be2e702ef51873b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab693125979f4bb7b7b3c94061610fe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:06:07.374359 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-13bff4b3-55ff-4db7-8b69-9bab5c308f16 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] 10.222.0.43 "GET /compute/v2.1/servers/ca231b38-fd3e-43ba-9cba-1de10a1ffeec" status: 200 len: 1369 microversion: 2.1 time: 0.240804 Jun 29 08:06:07.374953 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 179/354] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:06:07 2022] GET /compute/v2.1/servers/ca231b38-fd3e-43ba-9cba-1de10a1ffeec => generated 1369 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:06:07.375088 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-293eb340-b1ed-4722-b8b8-b056675fc78a tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:06:07.376182 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-293eb340-b1ed-4722-b8b8-b056675fc78a tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] [instance: 4a523b7d-76fc-4f57-9bfe-c9c2b4b0b8c8] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:06:07.394016 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-293eb340-b1ed-4722-b8b8-b056675fc78a tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:07.394787 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-293eb340-b1ed-4722-b8b8-b056675fc78a tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:07.396290 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-293eb340-b1ed-4722-b8b8-b056675fc78a tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:07.397185 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-293eb340-b1ed-4722-b8b8-b056675fc78a tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:07.512915 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-9020f263-1f16-43c8-b841-bf96c488abe0 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:06:07.514329 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-9020f263-1f16-43c8-b841-bf96c488abe0 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] [instance: f99567d1-cadf-40c5-b1dc-f86739b2b16c] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:06:07.525715 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-9020f263-1f16-43c8-b841-bf96c488abe0 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:07.526491 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-9020f263-1f16-43c8-b841-bf96c488abe0 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:07.527173 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-9020f263-1f16-43c8-b841-bf96c488abe0 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:07.527665 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-9020f263-1f16-43c8-b841-bf96c488abe0 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:07.593534 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-293eb340-b1ed-4722-b8b8-b056675fc78a tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6663857e60ca4440a9a620007be4c2c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7afb1bdb06042f4b983631745f32e19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:06:07.603029 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-293eb340-b1ed-4722-b8b8-b056675fc78a tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] 10.222.0.43 "GET /compute/v2.1/servers/4a523b7d-76fc-4f57-9bfe-c9c2b4b0b8c8" status: 200 len: 1356 microversion: 2.1 time: 0.237955 Jun 29 08:06:07.603627 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 176/355] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:06:07 2022] GET /compute/v2.1/servers/4a523b7d-76fc-4f57-9bfe-c9c2b4b0b8c8 => generated 1356 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:06:07.711173 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-9020f263-1f16-43c8-b841-bf96c488abe0 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:06:07.719801 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-9020f263-1f16-43c8-b841-bf96c488abe0 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:06:07.722080 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-9020f263-1f16-43c8-b841-bf96c488abe0 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:06:07.723317 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-9020f263-1f16-43c8-b841-bf96c488abe0 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] 10.222.0.43 "GET /compute/v2.1/servers/f99567d1-cadf-40c5-b1dc-f86739b2b16c" status: 200 len: 1723 microversion: 2.20 time: 0.215312 Jun 29 08:06:07.723883 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 180/356] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 29 08:06:07 2022] GET /compute/v2.1/servers/f99567d1-cadf-40c5-b1dc-f86739b2b16c => generated 1723 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:06:08.393536 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-ec5279c4-2d1a-4eaf-bbfe-5a8d1f4e4f9b tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:06:08.394432 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-ec5279c4-2d1a-4eaf-bbfe-5a8d1f4e4f9b tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] [instance: ca231b38-fd3e-43ba-9cba-1de10a1ffeec] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:06:08.404305 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ec5279c4-2d1a-4eaf-bbfe-5a8d1f4e4f9b tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:08.405065 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ec5279c4-2d1a-4eaf-bbfe-5a8d1f4e4f9b tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:08.406225 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ec5279c4-2d1a-4eaf-bbfe-5a8d1f4e4f9b tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:08.407085 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ec5279c4-2d1a-4eaf-bbfe-5a8d1f4e4f9b tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:08.590904 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-ec5279c4-2d1a-4eaf-bbfe-5a8d1f4e4f9b tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4af4eedee24897be2e702ef51873b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab693125979f4bb7b7b3c94061610fe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:06:08.610468 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-ec5279c4-2d1a-4eaf-bbfe-5a8d1f4e4f9b tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] 10.222.0.43 "GET /compute/v2.1/servers/ca231b38-fd3e-43ba-9cba-1de10a1ffeec" status: 200 len: 1369 microversion: 2.1 time: 0.221547 Jun 29 08:06:08.611436 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 177/357] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:06:08 2022] GET /compute/v2.1/servers/ca231b38-fd3e-43ba-9cba-1de10a1ffeec => generated 1369 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:06:08.634833 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-77920385-3486-4114-9007-8345e02807a7 tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:06:08.635526 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-77920385-3486-4114-9007-8345e02807a7 tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] [instance: 4a523b7d-76fc-4f57-9bfe-c9c2b4b0b8c8] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:06:08.642562 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-77920385-3486-4114-9007-8345e02807a7 tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:08.643119 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-77920385-3486-4114-9007-8345e02807a7 tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:08.644079 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-77920385-3486-4114-9007-8345e02807a7 tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:08.644679 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-77920385-3486-4114-9007-8345e02807a7 tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:08.743210 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-6fc84f1b-6b54-4739-9f7d-c6ed403ae76d tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:06:08.743852 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-6fc84f1b-6b54-4739-9f7d-c6ed403ae76d tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] [instance: f99567d1-cadf-40c5-b1dc-f86739b2b16c] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:06:08.750315 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-6fc84f1b-6b54-4739-9f7d-c6ed403ae76d tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:08.750768 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-6fc84f1b-6b54-4739-9f7d-c6ed403ae76d tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:08.757673 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-6fc84f1b-6b54-4739-9f7d-c6ed403ae76d tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:08.758164 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-6fc84f1b-6b54-4739-9f7d-c6ed403ae76d tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:08.841247 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-77920385-3486-4114-9007-8345e02807a7 tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6663857e60ca4440a9a620007be4c2c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7afb1bdb06042f4b983631745f32e19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:06:08.853284 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-77920385-3486-4114-9007-8345e02807a7 tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] 10.222.0.43 "GET /compute/v2.1/servers/4a523b7d-76fc-4f57-9bfe-c9c2b4b0b8c8" status: 200 len: 1356 microversion: 2.1 time: 0.223938 Jun 29 08:06:08.854163 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 181/358] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:06:08 2022] GET /compute/v2.1/servers/4a523b7d-76fc-4f57-9bfe-c9c2b4b0b8c8 => generated 1356 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:06:08.947916 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-6fc84f1b-6b54-4739-9f7d-c6ed403ae76d tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:06:08.963206 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-6fc84f1b-6b54-4739-9f7d-c6ed403ae76d tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:06:08.966007 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-6fc84f1b-6b54-4739-9f7d-c6ed403ae76d tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:06:08.967844 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-6fc84f1b-6b54-4739-9f7d-c6ed403ae76d tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] 10.222.0.43 "GET /compute/v2.1/servers/f99567d1-cadf-40c5-b1dc-f86739b2b16c" status: 200 len: 1723 microversion: 2.20 time: 0.228227 Jun 29 08:06:08.969198 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 178/359] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 29 08:06:08 2022] GET /compute/v2.1/servers/f99567d1-cadf-40c5-b1dc-f86739b2b16c => generated 1723 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 29 08:06:09.627480 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-c5a53312-eaef-4953-8800-7f1eb4031ae0 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:06:09.628065 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-c5a53312-eaef-4953-8800-7f1eb4031ae0 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] [instance: ca231b38-fd3e-43ba-9cba-1de10a1ffeec] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:06:09.634409 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-c5a53312-eaef-4953-8800-7f1eb4031ae0 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:09.634869 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-c5a53312-eaef-4953-8800-7f1eb4031ae0 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:09.635639 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-c5a53312-eaef-4953-8800-7f1eb4031ae0 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:09.636088 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-c5a53312-eaef-4953-8800-7f1eb4031ae0 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:09.805643 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-c5a53312-eaef-4953-8800-7f1eb4031ae0 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4af4eedee24897be2e702ef51873b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab693125979f4bb7b7b3c94061610fe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:06:09.813535 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-c5a53312-eaef-4953-8800-7f1eb4031ae0 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] 10.222.0.43 "GET /compute/v2.1/servers/ca231b38-fd3e-43ba-9cba-1de10a1ffeec" status: 200 len: 1563 microversion: 2.1 time: 0.190023 Jun 29 08:06:09.814115 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 182/360] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:06:09 2022] GET /compute/v2.1/servers/ca231b38-fd3e-43ba-9cba-1de10a1ffeec => generated 1563 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:06:09.832237 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-7ff762e7-e4c3-4e30-a7e0-34a79a4db765 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:06:09.832804 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-7ff762e7-e4c3-4e30-a7e0-34a79a4db765 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] [instance: ca231b38-fd3e-43ba-9cba-1de10a1ffeec] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:06:09.840548 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-7ff762e7-e4c3-4e30-a7e0-34a79a4db765 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:09.841025 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-7ff762e7-e4c3-4e30-a7e0-34a79a4db765 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:09.841824 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-7ff762e7-e4c3-4e30-a7e0-34a79a4db765 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:09.842260 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-7ff762e7-e4c3-4e30-a7e0-34a79a4db765 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:09.871357 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-b8cb9040-198f-4c03-b7dc-544ec4a7abfa tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:06:09.871967 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-b8cb9040-198f-4c03-b7dc-544ec4a7abfa tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] [instance: 4a523b7d-76fc-4f57-9bfe-c9c2b4b0b8c8] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:06:09.878795 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-b8cb9040-198f-4c03-b7dc-544ec4a7abfa tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:09.879159 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-b8cb9040-198f-4c03-b7dc-544ec4a7abfa tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:09.879927 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-b8cb9040-198f-4c03-b7dc-544ec4a7abfa tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:09.880352 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-b8cb9040-198f-4c03-b7dc-544ec4a7abfa tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:09.924731 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-7ff762e7-e4c3-4e30-a7e0-34a79a4db765 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] 10.222.0.43 "GET /compute/v2.1/servers/ca231b38-fd3e-43ba-9cba-1de10a1ffeec/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.097469 Jun 29 08:06:09.925378 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 179/361] 10.222.0.43 () {58 vars in 1274 bytes} [Wed Jun 29 08:06:09 2022] GET /compute/v2.1/servers/ca231b38-fd3e-43ba-9cba-1de10a1ffeec/os-interface => generated 285 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:06:09.994396 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-0b9184b2-78b6-4d50-b9f7-b8218bfda336 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:06:09.995706 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-0b9184b2-78b6-4d50-b9f7-b8218bfda336 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] [instance: f99567d1-cadf-40c5-b1dc-f86739b2b16c] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:06:10.005283 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-0b9184b2-78b6-4d50-b9f7-b8218bfda336 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:10.006051 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-0b9184b2-78b6-4d50-b9f7-b8218bfda336 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:10.006864 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-0b9184b2-78b6-4d50-b9f7-b8218bfda336 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:10.007306 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-0b9184b2-78b6-4d50-b9f7-b8218bfda336 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:10.028423 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-b8cb9040-198f-4c03-b7dc-544ec4a7abfa tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6663857e60ca4440a9a620007be4c2c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7afb1bdb06042f4b983631745f32e19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:06:10.046951 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-b8cb9040-198f-4c03-b7dc-544ec4a7abfa tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] 10.222.0.43 "GET /compute/v2.1/servers/4a523b7d-76fc-4f57-9bfe-c9c2b4b0b8c8" status: 200 len: 1356 microversion: 2.1 time: 0.179294 Jun 29 08:06:10.047579 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 183/362] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:06:09 2022] GET /compute/v2.1/servers/4a523b7d-76fc-4f57-9bfe-c9c2b4b0b8c8 => generated 1356 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 08:06:10.275584 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-0b9184b2-78b6-4d50-b9f7-b8218bfda336 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:06:10.283975 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-0b9184b2-78b6-4d50-b9f7-b8218bfda336 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:06:10.285559 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-0b9184b2-78b6-4d50-b9f7-b8218bfda336 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:06:10.286754 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-0b9184b2-78b6-4d50-b9f7-b8218bfda336 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] 10.222.0.43 "GET /compute/v2.1/servers/f99567d1-cadf-40c5-b1dc-f86739b2b16c" status: 200 len: 1723 microversion: 2.20 time: 0.300627 Jun 29 08:06:10.287324 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 180/363] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 29 08:06:09 2022] GET /compute/v2.1/servers/f99567d1-cadf-40c5-b1dc-f86739b2b16c => generated 1723 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:06:11.075124 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-744601c9-838b-4690-86c6-bcf0144b270b tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:06:11.075974 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-744601c9-838b-4690-86c6-bcf0144b270b tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] [instance: 4a523b7d-76fc-4f57-9bfe-c9c2b4b0b8c8] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:06:11.077071 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [req-f69119df-e3c7-4ac3-aab5-f66ab35b0f42 req-51a47954-354d-4204-bb36-3b955068b2b1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ca231b38-fd3e-43ba-9cba-1de10a1ffeec", "tag": "5a5ce414-6f70-43b5-a7cc-7340f679070a"}]} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:06:11.083235 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-744601c9-838b-4690-86c6-bcf0144b270b tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:11.083962 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-744601c9-838b-4690-86c6-bcf0144b270b tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:11.084749 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-744601c9-838b-4690-86c6-bcf0144b270b tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:11.085249 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-744601c9-838b-4690-86c6-bcf0144b270b tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:11.086478 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-f69119df-e3c7-4ac3-aab5-f66ab35b0f42 req-51a47954-354d-4204-bb36-3b955068b2b1 service nova] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:11.086928 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-f69119df-e3c7-4ac3-aab5-f66ab35b0f42 req-51a47954-354d-4204-bb36-3b955068b2b1 service nova] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:11.089972 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG dbcounter [-] [117890] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:06:11.100020 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.compute.server_external_events [req-f69119df-e3c7-4ac3-aab5-f66ab35b0f42 req-51a47954-354d-4204-bb36-3b955068b2b1 service nova] Creating event network-changed:5a5ce414-6f70-43b5-a7cc-7340f679070a for instance ca231b38-fd3e-43ba-9cba-1de10a1ffeec on hv-cinder-76810 Jun 29 08:06:11.107465 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [req-f69119df-e3c7-4ac3-aab5-f66ab35b0f42 req-51a47954-354d-4204-bb36-3b955068b2b1 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033804 Jun 29 08:06:11.108668 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 181/364] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jun 29 08:06:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:06:11.256772 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-744601c9-838b-4690-86c6-bcf0144b270b tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6663857e60ca4440a9a620007be4c2c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7afb1bdb06042f4b983631745f32e19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:06:11.264343 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-744601c9-838b-4690-86c6-bcf0144b270b tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] 10.222.0.43 "GET /compute/v2.1/servers/4a523b7d-76fc-4f57-9bfe-c9c2b4b0b8c8" status: 200 len: 1356 microversion: 2.1 time: 0.193078 Jun 29 08:06:11.264918 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 184/365] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:06:11 2022] GET /compute/v2.1/servers/4a523b7d-76fc-4f57-9bfe-c9c2b4b0b8c8 => generated 1356 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:06:11.317989 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-973defc9-c3c7-4599-87a1-6637d60ad61b tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:06:11.318745 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-973defc9-c3c7-4599-87a1-6637d60ad61b tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] [instance: f99567d1-cadf-40c5-b1dc-f86739b2b16c] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:06:11.325112 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-973defc9-c3c7-4599-87a1-6637d60ad61b tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:11.325653 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-973defc9-c3c7-4599-87a1-6637d60ad61b tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:11.326434 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-973defc9-c3c7-4599-87a1-6637d60ad61b tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:11.326875 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-973defc9-c3c7-4599-87a1-6637d60ad61b tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:11.464190 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-973defc9-c3c7-4599-87a1-6637d60ad61b tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:06:11.472478 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-973defc9-c3c7-4599-87a1-6637d60ad61b tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:06:11.474009 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-973defc9-c3c7-4599-87a1-6637d60ad61b tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:06:11.475172 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-973defc9-c3c7-4599-87a1-6637d60ad61b tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] 10.222.0.43 "GET /compute/v2.1/servers/f99567d1-cadf-40c5-b1dc-f86739b2b16c" status: 200 len: 1723 microversion: 2.20 time: 0.163324 Jun 29 08:06:11.475733 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 182/366] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 29 08:06:11 2022] GET /compute/v2.1/servers/f99567d1-cadf-40c5-b1dc-f86739b2b16c => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:06:12.282019 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-5008f39e-5f43-4a05-a82c-0596640e7a5f tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:06:12.282638 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-5008f39e-5f43-4a05-a82c-0596640e7a5f tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] [instance: 4a523b7d-76fc-4f57-9bfe-c9c2b4b0b8c8] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:06:12.289909 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-5008f39e-5f43-4a05-a82c-0596640e7a5f tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:12.290355 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-5008f39e-5f43-4a05-a82c-0596640e7a5f tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:12.291140 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-5008f39e-5f43-4a05-a82c-0596640e7a5f tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:12.291575 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-5008f39e-5f43-4a05-a82c-0596640e7a5f tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:12.466859 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-5008f39e-5f43-4a05-a82c-0596640e7a5f tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6663857e60ca4440a9a620007be4c2c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7afb1bdb06042f4b983631745f32e19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:06:12.482503 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-5008f39e-5f43-4a05-a82c-0596640e7a5f tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] 10.222.0.43 "GET /compute/v2.1/servers/4a523b7d-76fc-4f57-9bfe-c9c2b4b0b8c8" status: 200 len: 1356 microversion: 2.1 time: 0.204061 Jun 29 08:06:12.483555 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 185/367] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:06:12 2022] GET /compute/v2.1/servers/4a523b7d-76fc-4f57-9bfe-c9c2b4b0b8c8 => generated 1356 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 08:06:12.494666 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-2e944268-1cd1-4c1a-8f8d-969d4b54446e tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:06:12.495401 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-2e944268-1cd1-4c1a-8f8d-969d4b54446e tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] [instance: f99567d1-cadf-40c5-b1dc-f86739b2b16c] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:06:12.502891 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-2e944268-1cd1-4c1a-8f8d-969d4b54446e tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:12.503342 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-2e944268-1cd1-4c1a-8f8d-969d4b54446e tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:12.504338 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-2e944268-1cd1-4c1a-8f8d-969d4b54446e tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:12.504783 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-2e944268-1cd1-4c1a-8f8d-969d4b54446e tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:12.664886 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-2e944268-1cd1-4c1a-8f8d-969d4b54446e tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:06:12.674424 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-2e944268-1cd1-4c1a-8f8d-969d4b54446e tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:06:12.676264 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-2e944268-1cd1-4c1a-8f8d-969d4b54446e tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:06:12.677622 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-2e944268-1cd1-4c1a-8f8d-969d4b54446e tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] 10.222.0.43 "GET /compute/v2.1/servers/f99567d1-cadf-40c5-b1dc-f86739b2b16c" status: 200 len: 1723 microversion: 2.20 time: 0.187008 Jun 29 08:06:12.678479 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 183/368] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 29 08:06:12 2022] GET /compute/v2.1/servers/f99567d1-cadf-40c5-b1dc-f86739b2b16c => generated 1723 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 29 08:06:13.508229 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-e526e744-7a2b-403e-9f7b-b6a76ebd95ab tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:06:13.508851 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-e526e744-7a2b-403e-9f7b-b6a76ebd95ab tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] [instance: 4a523b7d-76fc-4f57-9bfe-c9c2b4b0b8c8] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:06:13.515736 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-e526e744-7a2b-403e-9f7b-b6a76ebd95ab tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:13.516182 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-e526e744-7a2b-403e-9f7b-b6a76ebd95ab tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:13.516994 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-e526e744-7a2b-403e-9f7b-b6a76ebd95ab tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:13.517447 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-e526e744-7a2b-403e-9f7b-b6a76ebd95ab tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:13.668806 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-e526e744-7a2b-403e-9f7b-b6a76ebd95ab tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6663857e60ca4440a9a620007be4c2c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7afb1bdb06042f4b983631745f32e19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:06:13.683845 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-e526e744-7a2b-403e-9f7b-b6a76ebd95ab tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] 10.222.0.43 "GET /compute/v2.1/servers/4a523b7d-76fc-4f57-9bfe-c9c2b4b0b8c8" status: 200 len: 1356 microversion: 2.1 time: 0.179068 Jun 29 08:06:13.684842 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 186/369] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:06:13 2022] GET /compute/v2.1/servers/4a523b7d-76fc-4f57-9bfe-c9c2b4b0b8c8 => generated 1356 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:06:13.706800 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-f867cb03-6439-4435-b585-9fe3ad3fe4e7 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:06:13.707626 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-f867cb03-6439-4435-b585-9fe3ad3fe4e7 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] [instance: f99567d1-cadf-40c5-b1dc-f86739b2b16c] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:06:13.716186 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-f867cb03-6439-4435-b585-9fe3ad3fe4e7 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:13.716655 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-f867cb03-6439-4435-b585-9fe3ad3fe4e7 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:13.717514 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-f867cb03-6439-4435-b585-9fe3ad3fe4e7 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:13.717942 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-f867cb03-6439-4435-b585-9fe3ad3fe4e7 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:13.902861 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-f867cb03-6439-4435-b585-9fe3ad3fe4e7 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:06:13.913282 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-f867cb03-6439-4435-b585-9fe3ad3fe4e7 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:06:13.914998 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-f867cb03-6439-4435-b585-9fe3ad3fe4e7 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:06:13.916242 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-f867cb03-6439-4435-b585-9fe3ad3fe4e7 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] 10.222.0.43 "GET /compute/v2.1/servers/f99567d1-cadf-40c5-b1dc-f86739b2b16c" status: 200 len: 1726 microversion: 2.20 time: 0.213825 Jun 29 08:06:13.916830 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 184/370] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 29 08:06:13 2022] GET /compute/v2.1/servers/f99567d1-cadf-40c5-b1dc-f86739b2b16c => generated 1726 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:06:13.936662 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-067c18fa-bf52-4d7d-96f7-d7392e425a90 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6eee2879-261b-434a-a378-3814ba506502"}} {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:06:13.942202 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-067c18fa-bf52-4d7d-96f7-d7392e425a90 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] [instance: f99567d1-cadf-40c5-b1dc-f86739b2b16c] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:06:13.948637 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-067c18fa-bf52-4d7d-96f7-d7392e425a90 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:13.949382 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-067c18fa-bf52-4d7d-96f7-d7392e425a90 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:13.950230 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-067c18fa-bf52-4d7d-96f7-d7392e425a90 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:13.950817 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-067c18fa-bf52-4d7d-96f7-d7392e425a90 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:14.341426 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-067c18fa-bf52-4d7d-96f7-d7392e425a90 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] 10.222.0.43 "POST /compute/v2.1/servers/f99567d1-cadf-40c5-b1dc-f86739b2b16c/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.410877 Jun 29 08:06:14.342180 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 187/371] 10.222.0.43 () {62 vars in 1363 bytes} [Wed Jun 29 08:06:13 2022] POST /compute/v2.1/servers/f99567d1-cadf-40c5-b1dc-f86739b2b16c/os-volume_attachments => generated 188 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 29 08:06:14.512733 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-c6883e9e-f54c-4f6e-99b4-c0b7ca7c2862 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:06:14.514292 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-c6883e9e-f54c-4f6e-99b4-c0b7ca7c2862 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] [instance: f99567d1-cadf-40c5-b1dc-f86739b2b16c] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:06:14.527625 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c6883e9e-f54c-4f6e-99b4-c0b7ca7c2862 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:14.528935 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c6883e9e-f54c-4f6e-99b4-c0b7ca7c2862 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:14.531303 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c6883e9e-f54c-4f6e-99b4-c0b7ca7c2862 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:14.532322 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c6883e9e-f54c-4f6e-99b4-c0b7ca7c2862 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:14.667682 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_cell1:SELECT=100 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:06:14.715109 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-1149806e-705f-4bd6-b8ea-04357355afa8 tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:06:14.717467 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-1149806e-705f-4bd6-b8ea-04357355afa8 tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] [instance: 4a523b7d-76fc-4f57-9bfe-c9c2b4b0b8c8] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:06:14.733515 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-1149806e-705f-4bd6-b8ea-04357355afa8 tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:14.734833 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-1149806e-705f-4bd6-b8ea-04357355afa8 tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:14.738044 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-1149806e-705f-4bd6-b8ea-04357355afa8 tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:14.739014 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-1149806e-705f-4bd6-b8ea-04357355afa8 tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:14.792611 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-c6883e9e-f54c-4f6e-99b4-c0b7ca7c2862 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] 10.222.0.43 "POST /compute/v2.1/servers/f99567d1-cadf-40c5-b1dc-f86739b2b16c/action" status: 202 len: 0 microversion: 2.20 time: 0.296238 Jun 29 08:06:14.803817 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 185/372] 10.222.0.43 () {62 vars in 1318 bytes} [Wed Jun 29 08:06:14 2022] POST /compute/v2.1/servers/f99567d1-cadf-40c5-b1dc-f86739b2b16c/action => generated 0 bytes in 307 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 29 08:06:14.815085 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-93846e19-0a12-407d-ad85-71b4bd0ae69f tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:06:14.816865 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-93846e19-0a12-407d-ad85-71b4bd0ae69f tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] [instance: f99567d1-cadf-40c5-b1dc-f86739b2b16c] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:06:14.869526 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-93846e19-0a12-407d-ad85-71b4bd0ae69f tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:14.870157 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-93846e19-0a12-407d-ad85-71b4bd0ae69f tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:14.872312 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-93846e19-0a12-407d-ad85-71b4bd0ae69f tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:14.873549 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-93846e19-0a12-407d-ad85-71b4bd0ae69f tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:15.172016 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-1149806e-705f-4bd6-b8ea-04357355afa8 tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6663857e60ca4440a9a620007be4c2c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7afb1bdb06042f4b983631745f32e19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:06:15.187047 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-1149806e-705f-4bd6-b8ea-04357355afa8 tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] 10.222.0.43 "GET /compute/v2.1/servers/4a523b7d-76fc-4f57-9bfe-c9c2b4b0b8c8" status: 200 len: 1356 microversion: 2.1 time: 0.482428 Jun 29 08:06:15.197033 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 188/373] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:06:14 2022] GET /compute/v2.1/servers/4a523b7d-76fc-4f57-9bfe-c9c2b4b0b8c8 => generated 1356 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 08:06:15.205605 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-f0e56dd9-79bc-4976-94d5-319d3ebb3017 tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:06:15.206117 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-f0e56dd9-79bc-4976-94d5-319d3ebb3017 tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] [instance: 2e99307a-e437-4e8d-821c-319cc555e209] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:06:15.213966 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-f0e56dd9-79bc-4976-94d5-319d3ebb3017 tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:15.214425 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-f0e56dd9-79bc-4976-94d5-319d3ebb3017 tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:15.215247 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-f0e56dd9-79bc-4976-94d5-319d3ebb3017 tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:15.215689 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-f0e56dd9-79bc-4976-94d5-319d3ebb3017 tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:15.262707 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-f0e56dd9-79bc-4976-94d5-319d3ebb3017 tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] [instance: 2e99307a-e437-4e8d-821c-319cc555e209] Going to try to terminate instance {{(pid=117890) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 29 08:06:15.343959 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-93846e19-0a12-407d-ad85-71b4bd0ae69f tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:06:15.360206 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-93846e19-0a12-407d-ad85-71b4bd0ae69f tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:06:15.362575 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-93846e19-0a12-407d-ad85-71b4bd0ae69f tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:06:15.364740 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-93846e19-0a12-407d-ad85-71b4bd0ae69f tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] 10.222.0.43 "GET /compute/v2.1/servers/f99567d1-cadf-40c5-b1dc-f86739b2b16c" status: 200 len: 1752 microversion: 2.20 time: 0.558462 Jun 29 08:06:15.366625 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 186/374] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 29 08:06:14 2022] GET /compute/v2.1/servers/f99567d1-cadf-40c5-b1dc-f86739b2b16c => generated 1752 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:06:15.395838 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-f0e56dd9-79bc-4976-94d5-319d3ebb3017 tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] 10.222.0.43 "DELETE /compute/v2.1/servers/2e99307a-e437-4e8d-821c-319cc555e209" status: 204 len: 0 microversion: 2.1 time: 0.206772 Jun 29 08:06:15.396621 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 189/375] 10.222.0.43 () {58 vars in 1238 bytes} [Wed Jun 29 08:06:15 2022] DELETE /compute/v2.1/servers/2e99307a-e437-4e8d-821c-319cc555e209 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 29 08:06:15.405831 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-a9572a7b-42e7-487e-9f60-81bd69898cf0 tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:06:15.406961 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-a9572a7b-42e7-487e-9f60-81bd69898cf0 tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] [instance: 2e99307a-e437-4e8d-821c-319cc555e209] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:06:15.414358 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-a9572a7b-42e7-487e-9f60-81bd69898cf0 tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:15.415189 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-a9572a7b-42e7-487e-9f60-81bd69898cf0 tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:15.416055 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-a9572a7b-42e7-487e-9f60-81bd69898cf0 tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:15.416727 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-a9572a7b-42e7-487e-9f60-81bd69898cf0 tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:15.615843 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-a9572a7b-42e7-487e-9f60-81bd69898cf0 tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1feaba97f594ffda9dd2962bebdc082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdadf97d44048c3bec51c0ae58ee4a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:06:15.628968 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-a9572a7b-42e7-487e-9f60-81bd69898cf0 tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] 10.222.0.43 "GET /compute/v2.1/servers/2e99307a-e437-4e8d-821c-319cc555e209" status: 200 len: 1512 microversion: 2.1 time: 0.227432 Jun 29 08:06:15.629861 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 187/376] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:06:15 2022] GET /compute/v2.1/servers/2e99307a-e437-4e8d-821c-319cc555e209 => generated 1512 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 08:06:15.877791 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-b8885d82-89fc-45c4-aa0c-13042308bf21 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1722946963", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-915127236", "security_groups": [{"name": "tempest-secgroup-smoke-2021534547"}], "networks": [{"uuid": "5b74e483-4a84-4149-9ef0-91f3e14ff64f"}], "block_device_mapping_v2": [{"uuid": "276fbb34-ef9f-449a-9dfb-064538c58a73", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:06:16.083287 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.network.neutron [None req-b8885d82-89fc-45c4-aa0c-13042308bf21 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] validate_networks() for [('5b74e483-4a84-4149-9ef0-91f3e14ff64f', None, None, None, None, None)] {{(pid=117890) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 29 08:06:16.213951 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-709151f5-4661-409c-84dd-a78c8609f98e tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:06:16.215217 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-709151f5-4661-409c-84dd-a78c8609f98e tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] [instance: 4a523b7d-76fc-4f57-9bfe-c9c2b4b0b8c8] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:06:16.238797 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-709151f5-4661-409c-84dd-a78c8609f98e tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:16.239644 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-709151f5-4661-409c-84dd-a78c8609f98e tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:16.241050 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-709151f5-4661-409c-84dd-a78c8609f98e tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:16.241773 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-709151f5-4661-409c-84dd-a78c8609f98e tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:16.565517 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-709151f5-4661-409c-84dd-a78c8609f98e tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6663857e60ca4440a9a620007be4c2c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7afb1bdb06042f4b983631745f32e19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:06:16.601120 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-709151f5-4661-409c-84dd-a78c8609f98e tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] 10.222.0.43 "GET /compute/v2.1/servers/4a523b7d-76fc-4f57-9bfe-c9c2b4b0b8c8" status: 200 len: 1356 microversion: 2.1 time: 0.393310 Jun 29 08:06:16.605025 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 188/377] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:06:16 2022] GET /compute/v2.1/servers/4a523b7d-76fc-4f57-9bfe-c9c2b4b0b8c8 => generated 1356 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:06:16.623090 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-2908079a-d852-4fd6-9123-e48c8eeb6fbc tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:06:16.624034 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-2908079a-d852-4fd6-9123-e48c8eeb6fbc tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] [instance: f99567d1-cadf-40c5-b1dc-f86739b2b16c] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:06:16.634822 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-2908079a-d852-4fd6-9123-e48c8eeb6fbc tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:16.635550 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-2908079a-d852-4fd6-9123-e48c8eeb6fbc tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:16.636550 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-2908079a-d852-4fd6-9123-e48c8eeb6fbc tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:16.637531 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-2908079a-d852-4fd6-9123-e48c8eeb6fbc tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:16.811365 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-2908079a-d852-4fd6-9123-e48c8eeb6fbc tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:06:16.823220 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-2908079a-d852-4fd6-9123-e48c8eeb6fbc tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:06:16.825409 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-2908079a-d852-4fd6-9123-e48c8eeb6fbc tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:06:16.826199 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-2908079a-d852-4fd6-9123-e48c8eeb6fbc tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] 10.222.0.43 "GET /compute/v2.1/servers/f99567d1-cadf-40c5-b1dc-f86739b2b16c" status: 200 len: 1752 microversion: 2.20 time: 0.216591 Jun 29 08:06:16.835619 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 189/378] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 29 08:06:16 2022] GET /compute/v2.1/servers/f99567d1-cadf-40c5-b1dc-f86739b2b16c => generated 1752 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:06:16.835619 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-301db7ad-5305-48b0-b0f0-e1338c627e09 tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:06:16.835619 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-301db7ad-5305-48b0-b0f0-e1338c627e09 tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] [instance: 2e99307a-e437-4e8d-821c-319cc555e209] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:06:16.841779 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-301db7ad-5305-48b0-b0f0-e1338c627e09 tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:16.842236 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-301db7ad-5305-48b0-b0f0-e1338c627e09 tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:16.843024 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-301db7ad-5305-48b0-b0f0-e1338c627e09 tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:16.843464 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-301db7ad-5305-48b0-b0f0-e1338c627e09 tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:16.912481 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.virt.hardware [None req-b8885d82-89fc-45c4-aa0c-13042308bf21 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Flavor limits 0:0:0 {{(pid=117890) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 29 08:06:16.913712 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.virt.hardware [None req-b8885d82-89fc-45c4-aa0c-13042308bf21 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Image limits 0:0:0 {{(pid=117890) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 29 08:06:16.914399 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.virt.hardware [None req-b8885d82-89fc-45c4-aa0c-13042308bf21 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Flavor pref 0:0:0 {{(pid=117890) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 29 08:06:16.914999 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.virt.hardware [None req-b8885d82-89fc-45c4-aa0c-13042308bf21 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Image pref 0:0:0 {{(pid=117890) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 29 08:06:16.915602 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.virt.hardware [None req-b8885d82-89fc-45c4-aa0c-13042308bf21 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117890) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 29 08:06:16.931168 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-b8885d82-89fc-45c4-aa0c-13042308bf21 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:16.931898 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-b8885d82-89fc-45c4-aa0c-13042308bf21 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:16.932920 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-b8885d82-89fc-45c4-aa0c-13042308bf21 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:16.933392 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-b8885d82-89fc-45c4-aa0c-13042308bf21 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:16.957154 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.quota [None req-b8885d82-89fc-45c4-aa0c-13042308bf21 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Getting quotas for project 26a20f6f9f254aae91c952ee44a4ff74. Resources: {'ram', 'instances', 'cores'} {{(pid=117890) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 29 08:06:16.962398 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.quota [None req-b8885d82-89fc-45c4-aa0c-13042308bf21 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Getting quotas for user de6636a0522642799e43a8f02ee602ea and project 26a20f6f9f254aae91c952ee44a4ff74. Resources: {'ram', 'instances', 'cores'} {{(pid=117890) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 29 08:06:17.036229 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-b8885d82-89fc-45c4-aa0c-13042308bf21 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Going to run 1 instances... {{(pid=117890) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 29 08:06:17.036361 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-b8885d82-89fc-45c4-aa0c-13042308bf21 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] [instance: 83a86ef0-c066-44a7-b4eb-e32dce6e0069] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='276fbb34-ef9f-449a-9dfb-064538c58a73',volume_size=None,volume_type=None)] {{(pid=117890) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 29 08:06:17.100306 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-301db7ad-5305-48b0-b0f0-e1338c627e09 tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1feaba97f594ffda9dd2962bebdc082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdadf97d44048c3bec51c0ae58ee4a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:06:17.109566 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-301db7ad-5305-48b0-b0f0-e1338c627e09 tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] 10.222.0.43 "GET /compute/v2.1/servers/2e99307a-e437-4e8d-821c-319cc555e209" status: 200 len: 1512 microversion: 2.1 time: 0.281295 Jun 29 08:06:17.110158 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 190/379] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:06:16 2022] GET /compute/v2.1/servers/2e99307a-e437-4e8d-821c-319cc555e209 => generated 1512 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:06:17.203597 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-b8885d82-89fc-45c4-aa0c-13042308bf21 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.334828 Jun 29 08:06:17.204258 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 190/380] 10.222.0.43 () {60 vars in 1146 bytes} [Wed Jun 29 08:06:15 2022] POST /compute/v2.1/servers => generated 406 bytes in 1337 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 29 08:06:17.216684 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-cfcb1d41-7282-47c0-88a6-a93baddb9283 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:06:17.217581 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-cfcb1d41-7282-47c0-88a6-a93baddb9283 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] [instance: 83a86ef0-c066-44a7-b4eb-e32dce6e0069] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:06:17.289170 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-cfcb1d41-7282-47c0-88a6-a93baddb9283 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de6636a0522642799e43a8f02ee602ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a20f6f9f254aae91c952ee44a4ff74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:06:17.300789 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-cfcb1d41-7282-47c0-88a6-a93baddb9283 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] 10.222.0.43 "GET /compute/v2.1/servers/83a86ef0-c066-44a7-b4eb-e32dce6e0069" status: 200 len: 1088 microversion: 2.1 time: 0.087931 Jun 29 08:06:17.301629 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 191/381] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:06:17 2022] GET /compute/v2.1/servers/83a86ef0-c066-44a7-b4eb-e32dce6e0069 => generated 1088 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:06:17.633527 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-645286e5-b39c-45a9-9b4b-2103c6a070fd tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:06:17.634820 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-645286e5-b39c-45a9-9b4b-2103c6a070fd tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] [instance: 4a523b7d-76fc-4f57-9bfe-c9c2b4b0b8c8] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:06:17.643025 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-645286e5-b39c-45a9-9b4b-2103c6a070fd tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:17.643503 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-645286e5-b39c-45a9-9b4b-2103c6a070fd tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:17.644702 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-645286e5-b39c-45a9-9b4b-2103c6a070fd tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:17.646020 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-645286e5-b39c-45a9-9b4b-2103c6a070fd tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:17.863860 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-e6ff68cb-fb8a-43d2-b5ae-aac43fc6d2ad tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:06:17.866878 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-e6ff68cb-fb8a-43d2-b5ae-aac43fc6d2ad tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] [instance: f99567d1-cadf-40c5-b1dc-f86739b2b16c] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:06:17.871941 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-645286e5-b39c-45a9-9b4b-2103c6a070fd tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6663857e60ca4440a9a620007be4c2c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7afb1bdb06042f4b983631745f32e19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:06:17.880684 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e6ff68cb-fb8a-43d2-b5ae-aac43fc6d2ad tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:17.881568 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e6ff68cb-fb8a-43d2-b5ae-aac43fc6d2ad tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:17.883408 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e6ff68cb-fb8a-43d2-b5ae-aac43fc6d2ad tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:17.886126 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e6ff68cb-fb8a-43d2-b5ae-aac43fc6d2ad tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:17.888475 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-645286e5-b39c-45a9-9b4b-2103c6a070fd tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] 10.222.0.43 "GET /compute/v2.1/servers/4a523b7d-76fc-4f57-9bfe-c9c2b4b0b8c8" status: 200 len: 1356 microversion: 2.1 time: 0.261133 Jun 29 08:06:17.890237 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 191/382] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:06:17 2022] GET /compute/v2.1/servers/4a523b7d-76fc-4f57-9bfe-c9c2b4b0b8c8 => generated 1356 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:06:18.091076 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-e6ff68cb-fb8a-43d2-b5ae-aac43fc6d2ad tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:06:18.101976 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-e6ff68cb-fb8a-43d2-b5ae-aac43fc6d2ad tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:06:18.103628 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-e6ff68cb-fb8a-43d2-b5ae-aac43fc6d2ad tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:06:18.105094 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-e6ff68cb-fb8a-43d2-b5ae-aac43fc6d2ad tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] 10.222.0.43 "GET /compute/v2.1/servers/f99567d1-cadf-40c5-b1dc-f86739b2b16c" status: 200 len: 1752 microversion: 2.20 time: 0.250153 Jun 29 08:06:18.105910 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 192/383] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 29 08:06:17 2022] GET /compute/v2.1/servers/f99567d1-cadf-40c5-b1dc-f86739b2b16c => generated 1752 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 29 08:06:18.128753 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-727a8a5d-0581-400d-bf7d-5aeb1246701b tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:06:18.129524 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-727a8a5d-0581-400d-bf7d-5aeb1246701b tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] [instance: 2e99307a-e437-4e8d-821c-319cc555e209] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:06:18.140312 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-727a8a5d-0581-400d-bf7d-5aeb1246701b tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:18.141194 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-727a8a5d-0581-400d-bf7d-5aeb1246701b tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:18.149923 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-727a8a5d-0581-400d-bf7d-5aeb1246701b tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:18.151466 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-727a8a5d-0581-400d-bf7d-5aeb1246701b tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:18.320135 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-cd6026f1-3383-4962-bd07-fbc43f7a6eff tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:06:18.321547 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-cd6026f1-3383-4962-bd07-fbc43f7a6eff tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] [instance: 83a86ef0-c066-44a7-b4eb-e32dce6e0069] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:06:18.329465 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-cd6026f1-3383-4962-bd07-fbc43f7a6eff tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:18.331317 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-cd6026f1-3383-4962-bd07-fbc43f7a6eff tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:18.331317 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-cd6026f1-3383-4962-bd07-fbc43f7a6eff tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:18.331542 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-cd6026f1-3383-4962-bd07-fbc43f7a6eff tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:18.373087 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-727a8a5d-0581-400d-bf7d-5aeb1246701b tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1feaba97f594ffda9dd2962bebdc082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdadf97d44048c3bec51c0ae58ee4a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:06:18.398182 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-727a8a5d-0581-400d-bf7d-5aeb1246701b tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] 10.222.0.43 "GET /compute/v2.1/servers/2e99307a-e437-4e8d-821c-319cc555e209" status: 200 len: 1512 microversion: 2.1 time: 0.274482 Jun 29 08:06:18.409390 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 192/384] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:06:18 2022] GET /compute/v2.1/servers/2e99307a-e437-4e8d-821c-319cc555e209 => generated 1512 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:06:18.433509 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-cd6026f1-3383-4962-bd07-fbc43f7a6eff tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de6636a0522642799e43a8f02ee602ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a20f6f9f254aae91c952ee44a4ff74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:06:18.444491 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-cd6026f1-3383-4962-bd07-fbc43f7a6eff tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] 10.222.0.43 "GET /compute/v2.1/servers/83a86ef0-c066-44a7-b4eb-e32dce6e0069" status: 200 len: 1138 microversion: 2.1 time: 0.130314 Jun 29 08:06:18.445930 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 193/385] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:06:18 2022] GET /compute/v2.1/servers/83a86ef0-c066-44a7-b4eb-e32dce6e0069 => generated 1138 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 08:06:18.907410 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-5d0f02a4-c615-478f-92ed-46226f7d0f4b tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:06:18.910020 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-5d0f02a4-c615-478f-92ed-46226f7d0f4b tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] [instance: 4a523b7d-76fc-4f57-9bfe-c9c2b4b0b8c8] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:06:18.917782 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-5d0f02a4-c615-478f-92ed-46226f7d0f4b tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:18.918495 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-5d0f02a4-c615-478f-92ed-46226f7d0f4b tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:18.919678 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-5d0f02a4-c615-478f-92ed-46226f7d0f4b tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:18.920433 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-5d0f02a4-c615-478f-92ed-46226f7d0f4b tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:19.131294 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-1f5ce775-5ef6-4998-b0dd-131aad8ce46c tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:06:19.132908 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-1f5ce775-5ef6-4998-b0dd-131aad8ce46c tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] [instance: f99567d1-cadf-40c5-b1dc-f86739b2b16c] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:06:19.145666 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-1f5ce775-5ef6-4998-b0dd-131aad8ce46c tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:19.146447 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-1f5ce775-5ef6-4998-b0dd-131aad8ce46c tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:19.147889 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-1f5ce775-5ef6-4998-b0dd-131aad8ce46c tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:19.148879 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-1f5ce775-5ef6-4998-b0dd-131aad8ce46c tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:19.365887 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-5d0f02a4-c615-478f-92ed-46226f7d0f4b tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6663857e60ca4440a9a620007be4c2c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7afb1bdb06042f4b983631745f32e19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:06:19.386023 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-1f5ce775-5ef6-4998-b0dd-131aad8ce46c tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:06:19.395919 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-1f5ce775-5ef6-4998-b0dd-131aad8ce46c tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:06:19.397774 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-1f5ce775-5ef6-4998-b0dd-131aad8ce46c tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:06:19.399192 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-1f5ce775-5ef6-4998-b0dd-131aad8ce46c tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] 10.222.0.43 "GET /compute/v2.1/servers/f99567d1-cadf-40c5-b1dc-f86739b2b16c" status: 200 len: 1754 microversion: 2.20 time: 0.276093 Jun 29 08:06:19.400010 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 194/386] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 29 08:06:19 2022] GET /compute/v2.1/servers/f99567d1-cadf-40c5-b1dc-f86739b2b16c => generated 1754 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:06:19.410738 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-5d0f02a4-c615-478f-92ed-46226f7d0f4b tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] 10.222.0.43 "GET /compute/v2.1/servers/4a523b7d-76fc-4f57-9bfe-c9c2b4b0b8c8" status: 200 len: 1356 microversion: 2.1 time: 0.483168 Jun 29 08:06:19.410738 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 193/387] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:06:18 2022] GET /compute/v2.1/servers/4a523b7d-76fc-4f57-9bfe-c9c2b4b0b8c8 => generated 1356 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:06:19.433816 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-07c2216f-3ec9-4195-ab67-f44e577ebcb8 tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:06:19.436379 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-07c2216f-3ec9-4195-ab67-f44e577ebcb8 tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] [instance: 2e99307a-e437-4e8d-821c-319cc555e209] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:06:19.453997 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-07c2216f-3ec9-4195-ab67-f44e577ebcb8 tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:19.456065 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-07c2216f-3ec9-4195-ab67-f44e577ebcb8 tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:19.462663 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-c34b33ae-10b9-4b3a-b4b9-21d4120b853f tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:06:19.463570 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-c34b33ae-10b9-4b3a-b4b9-21d4120b853f tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] [instance: 83a86ef0-c066-44a7-b4eb-e32dce6e0069] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:06:19.468396 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-07c2216f-3ec9-4195-ab67-f44e577ebcb8 tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:19.473020 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-07c2216f-3ec9-4195-ab67-f44e577ebcb8 tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:19.480602 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c34b33ae-10b9-4b3a-b4b9-21d4120b853f tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:19.483444 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c34b33ae-10b9-4b3a-b4b9-21d4120b853f tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:19.487044 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c34b33ae-10b9-4b3a-b4b9-21d4120b853f tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:19.489137 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c34b33ae-10b9-4b3a-b4b9-21d4120b853f tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:19.509944 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 29 08:06:19.510208 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: Wed Jun 29 08:06:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/83a86ef0-c066-44a7-b4eb-e32dce6e0069 (ip 10.222.0.43) !!! Jun 29 08:06:19.707470 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-c34b33ae-10b9-4b3a-b4b9-21d4120b853f tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de6636a0522642799e43a8f02ee602ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a20f6f9f254aae91c952ee44a4ff74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:06:19.723180 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-c34b33ae-10b9-4b3a-b4b9-21d4120b853f tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] 10.222.0.43 "GET /compute/v2.1/servers/83a86ef0-c066-44a7-b4eb-e32dce6e0069" status: 200 len: 1204 microversion: 2.1 time: 0.264829 Jun 29 08:06:19.727244 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 195/388] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:06:19 2022] GET /compute/v2.1/servers/83a86ef0-c066-44a7-b4eb-e32dce6e0069 => generated 1204 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:06:19.810112 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-07c2216f-3ec9-4195-ab67-f44e577ebcb8 tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1feaba97f594ffda9dd2962bebdc082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdadf97d44048c3bec51c0ae58ee4a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:06:19.822998 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-07c2216f-3ec9-4195-ab67-f44e577ebcb8 tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] 10.222.0.43 "GET /compute/v2.1/servers/2e99307a-e437-4e8d-821c-319cc555e209" status: 200 len: 1512 microversion: 2.1 time: 0.407144 Jun 29 08:06:19.842159 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 194/389] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:06:19 2022] GET /compute/v2.1/servers/2e99307a-e437-4e8d-821c-319cc555e209 => generated 1512 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:06:19.981126 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [req-27eecd07-0365-43fa-9736-940f6a70dae8 req-d8f03a48-e0ae-4fce-ba00-b6402235a8fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e99307a-e437-4e8d-821c-319cc555e209", "name": "network-vif-deleted", "tag": "dec20ad0-8f1a-494a-ad93-6642576929a5"}]} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:06:20.029949 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-27eecd07-0365-43fa-9736-940f6a70dae8 req-d8f03a48-e0ae-4fce-ba00-b6402235a8fa service nova] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:20.033722 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-27eecd07-0365-43fa-9736-940f6a70dae8 req-d8f03a48-e0ae-4fce-ba00-b6402235a8fa service nova] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:20.082269 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.compute.server_external_events [req-27eecd07-0365-43fa-9736-940f6a70dae8 req-d8f03a48-e0ae-4fce-ba00-b6402235a8fa service nova] Creating event network-vif-deleted:dec20ad0-8f1a-494a-ad93-6642576929a5 for instance 2e99307a-e437-4e8d-821c-319cc555e209 on hv-cinder-76810 Jun 29 08:06:20.085254 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [req-2ba50c10-e826-42e9-940a-31486322ef20 req-f82b4236-6520-4f3a-8bdd-c654659eca78 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a523b7d-76fc-4f57-9bfe-c9c2b4b0b8c8", "name": "network-vif-plugged", "status": "completed", "tag": "1315c7c2-f10d-4890-8b5e-93890c37db42"}]} {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:06:20.099372 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [req-27eecd07-0365-43fa-9736-940f6a70dae8 req-d8f03a48-e0ae-4fce-ba00-b6402235a8fa service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.122606 Jun 29 08:06:20.100814 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 196/390] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jun 29 08:06:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:06:20.117762 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [req-2ba50c10-e826-42e9-940a-31486322ef20 req-f82b4236-6520-4f3a-8bdd-c654659eca78 service nova] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:20.121949 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [req-2ba50c10-e826-42e9-940a-31486322ef20 req-f82b4236-6520-4f3a-8bdd-c654659eca78 service nova] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:20.169472 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.compute.server_external_events [req-2ba50c10-e826-42e9-940a-31486322ef20 req-f82b4236-6520-4f3a-8bdd-c654659eca78 service nova] Creating event network-vif-plugged:1315c7c2-f10d-4890-8b5e-93890c37db42 for instance 4a523b7d-76fc-4f57-9bfe-c9c2b4b0b8c8 on hv-cinder-76810 Jun 29 08:06:20.184275 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [req-2ba50c10-e826-42e9-940a-31486322ef20 req-f82b4236-6520-4f3a-8bdd-c654659eca78 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103199 Jun 29 08:06:20.184898 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 195/391] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jun 29 08:06:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 29 08:06:20.420943 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-76446545-5ddc-4106-91f3-445b8e905a8a tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:06:20.422628 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-76446545-5ddc-4106-91f3-445b8e905a8a tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] [instance: 4a523b7d-76fc-4f57-9bfe-c9c2b4b0b8c8] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:06:20.437036 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-76446545-5ddc-4106-91f3-445b8e905a8a tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:20.437511 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-76446545-5ddc-4106-91f3-445b8e905a8a tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:20.438324 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-76446545-5ddc-4106-91f3-445b8e905a8a tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:20.438770 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-76446545-5ddc-4106-91f3-445b8e905a8a tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:20.443128 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-43dbd218-e776-43f7-a739-0077d26a6d10 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:06:20.445278 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-43dbd218-e776-43f7-a739-0077d26a6d10 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] [instance: f99567d1-cadf-40c5-b1dc-f86739b2b16c] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:06:20.460085 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-43dbd218-e776-43f7-a739-0077d26a6d10 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:20.460957 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-43dbd218-e776-43f7-a739-0077d26a6d10 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:20.462483 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-43dbd218-e776-43f7-a739-0077d26a6d10 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:20.463318 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-43dbd218-e776-43f7-a739-0077d26a6d10 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:20.715865 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-76446545-5ddc-4106-91f3-445b8e905a8a tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6663857e60ca4440a9a620007be4c2c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7afb1bdb06042f4b983631745f32e19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:06:20.727003 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-76446545-5ddc-4106-91f3-445b8e905a8a tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] 10.222.0.43 "GET /compute/v2.1/servers/4a523b7d-76fc-4f57-9bfe-c9c2b4b0b8c8" status: 200 len: 1356 microversion: 2.1 time: 0.312140 Jun 29 08:06:20.730938 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 197/392] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:06:20 2022] GET /compute/v2.1/servers/4a523b7d-76fc-4f57-9bfe-c9c2b4b0b8c8 => generated 1356 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:06:20.746262 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-1b60f902-a1c3-429b-b9e3-c4bf6cd8a436 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:06:20.746876 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-1b60f902-a1c3-429b-b9e3-c4bf6cd8a436 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] [instance: 83a86ef0-c066-44a7-b4eb-e32dce6e0069] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:06:20.754518 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-1b60f902-a1c3-429b-b9e3-c4bf6cd8a436 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:20.755260 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-1b60f902-a1c3-429b-b9e3-c4bf6cd8a436 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:20.760405 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-1b60f902-a1c3-429b-b9e3-c4bf6cd8a436 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:20.760405 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-1b60f902-a1c3-429b-b9e3-c4bf6cd8a436 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:20.863477 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-43dbd218-e776-43f7-a739-0077d26a6d10 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:06:20.874334 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-43dbd218-e776-43f7-a739-0077d26a6d10 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:06:20.877999 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-43dbd218-e776-43f7-a739-0077d26a6d10 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:06:20.880073 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-43dbd218-e776-43f7-a739-0077d26a6d10 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] 10.222.0.43 "GET /compute/v2.1/servers/f99567d1-cadf-40c5-b1dc-f86739b2b16c" status: 200 len: 1810 microversion: 2.20 time: 0.456616 Jun 29 08:06:20.881018 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 196/393] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 29 08:06:20 2022] GET /compute/v2.1/servers/f99567d1-cadf-40c5-b1dc-f86739b2b16c => generated 1810 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 29 08:06:20.885677 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-834b4432-8320-4696-954e-cae148c11a36 tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:06:20.886245 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-834b4432-8320-4696-954e-cae148c11a36 tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] [instance: 2e99307a-e437-4e8d-821c-319cc555e209] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:06:20.894401 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-834b4432-8320-4696-954e-cae148c11a36 tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:20.895282 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-834b4432-8320-4696-954e-cae148c11a36 tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:20.896465 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-834b4432-8320-4696-954e-cae148c11a36 tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:20.897342 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-834b4432-8320-4696-954e-cae148c11a36 tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:20.934368 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-834b4432-8320-4696-954e-cae148c11a36 tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:20.935322 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-834b4432-8320-4696-954e-cae148c11a36 tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:20.936026 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.objects.instance [None req-834b4432-8320-4696-954e-cae148c11a36 tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Lazy-loading 'fault' on Instance uuid 2e99307a-e437-4e8d-821c-319cc555e209 {{(pid=117890) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 29 08:06:20.942861 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG dbcounter [-] [117890] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=117890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:06:20.951195 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-1b60f902-a1c3-429b-b9e3-c4bf6cd8a436 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de6636a0522642799e43a8f02ee602ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a20f6f9f254aae91c952ee44a4ff74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:06:20.962598 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-1b60f902-a1c3-429b-b9e3-c4bf6cd8a436 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] 10.222.0.43 "GET /compute/v2.1/servers/83a86ef0-c066-44a7-b4eb-e32dce6e0069" status: 200 len: 1272 microversion: 2.1 time: 0.221489 Jun 29 08:06:20.973827 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 198/394] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:06:20 2022] GET /compute/v2.1/servers/83a86ef0-c066-44a7-b4eb-e32dce6e0069 => generated 1272 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 08:06:21.012294 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-834b4432-8320-4696-954e-cae148c11a36 tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1feaba97f594ffda9dd2962bebdc082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdadf97d44048c3bec51c0ae58ee4a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:06:21.022956 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-834b4432-8320-4696-954e-cae148c11a36 tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] 10.222.0.43 "GET /compute/v2.1/servers/2e99307a-e437-4e8d-821c-319cc555e209" status: 200 len: 1308 microversion: 2.1 time: 0.140869 Jun 29 08:06:21.023556 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 197/395] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:06:20 2022] GET /compute/v2.1/servers/2e99307a-e437-4e8d-821c-319cc555e209 => generated 1308 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:06:21.745589 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-579415f6-6e1c-4ff4-ad5a-04f25ad041a6 tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:06:21.747103 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-579415f6-6e1c-4ff4-ad5a-04f25ad041a6 tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] [instance: 4a523b7d-76fc-4f57-9bfe-c9c2b4b0b8c8] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:06:21.757346 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-579415f6-6e1c-4ff4-ad5a-04f25ad041a6 tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:21.758256 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-579415f6-6e1c-4ff4-ad5a-04f25ad041a6 tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:21.759339 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-579415f6-6e1c-4ff4-ad5a-04f25ad041a6 tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:21.760024 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-579415f6-6e1c-4ff4-ad5a-04f25ad041a6 tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:21.899419 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-bc81ba2a-941a-4d29-9ff5-b2fc96054d02 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:06:21.900091 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-bc81ba2a-941a-4d29-9ff5-b2fc96054d02 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] [instance: f99567d1-cadf-40c5-b1dc-f86739b2b16c] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:06:21.909384 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-bc81ba2a-941a-4d29-9ff5-b2fc96054d02 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:21.909866 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-bc81ba2a-941a-4d29-9ff5-b2fc96054d02 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:21.910718 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-bc81ba2a-941a-4d29-9ff5-b2fc96054d02 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:21.911200 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-bc81ba2a-941a-4d29-9ff5-b2fc96054d02 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:22.024701 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-579415f6-6e1c-4ff4-ad5a-04f25ad041a6 tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6663857e60ca4440a9a620007be4c2c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7afb1bdb06042f4b983631745f32e19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:06:22.039735 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-579415f6-6e1c-4ff4-ad5a-04f25ad041a6 tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] 10.222.0.43 "GET /compute/v2.1/servers/4a523b7d-76fc-4f57-9bfe-c9c2b4b0b8c8" status: 200 len: 1356 microversion: 2.1 time: 0.298496 Jun 29 08:06:22.042569 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 199/396] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:06:21 2022] GET /compute/v2.1/servers/4a523b7d-76fc-4f57-9bfe-c9c2b4b0b8c8 => generated 1356 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:06:22.051191 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-de154407-e53c-4472-a6da-bb40aa32ca6d tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:06:22.052588 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-de154407-e53c-4472-a6da-bb40aa32ca6d tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] [instance: 83a86ef0-c066-44a7-b4eb-e32dce6e0069] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:06:22.065354 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-de154407-e53c-4472-a6da-bb40aa32ca6d tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:22.066873 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-de154407-e53c-4472-a6da-bb40aa32ca6d tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:22.067888 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-de154407-e53c-4472-a6da-bb40aa32ca6d tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:22.068506 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-de154407-e53c-4472-a6da-bb40aa32ca6d tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:22.165100 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-bc81ba2a-941a-4d29-9ff5-b2fc96054d02 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:06:22.176242 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-bc81ba2a-941a-4d29-9ff5-b2fc96054d02 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:06:22.178282 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-bc81ba2a-941a-4d29-9ff5-b2fc96054d02 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:06:22.180179 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-bc81ba2a-941a-4d29-9ff5-b2fc96054d02 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] 10.222.0.43 "GET /compute/v2.1/servers/f99567d1-cadf-40c5-b1dc-f86739b2b16c" status: 200 len: 1810 microversion: 2.20 time: 0.284556 Jun 29 08:06:22.181896 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 198/397] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 29 08:06:21 2022] GET /compute/v2.1/servers/f99567d1-cadf-40c5-b1dc-f86739b2b16c => generated 1810 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 29 08:06:22.196630 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-1dac75f4-fd59-4972-ba25-8289e490b81d tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:06:22.198018 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-1dac75f4-fd59-4972-ba25-8289e490b81d tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] [instance: 2e99307a-e437-4e8d-821c-319cc555e209] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:06:22.210668 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-1dac75f4-fd59-4972-ba25-8289e490b81d tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:22.213028 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-1dac75f4-fd59-4972-ba25-8289e490b81d tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:22.214145 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-1dac75f4-fd59-4972-ba25-8289e490b81d tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:22.217097 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-1dac75f4-fd59-4972-ba25-8289e490b81d tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:22.253954 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.wsgi [None req-1dac75f4-fd59-4972-ba25-8289e490b81d tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] HTTP exception thrown: Instance 2e99307a-e437-4e8d-821c-319cc555e209 could not be found. Jun 29 08:06:22.256148 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-1dac75f4-fd59-4972-ba25-8289e490b81d tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Request method failure captured: Jun 29 08:06:22.256148 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: request: GET /compute/v2.1/servers/2e99307a-e437-4e8d-821c-319cc555e209 HTTP/1.1 Jun 29 08:06:22.256148 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: Accept: application/json Jun 29 08:06:22.256148 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: Accept-Encoding: identity Jun 29 08:06:22.256148 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: Connection: close Jun 29 08:06:22.256148 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: Content-Length: 0 Jun 29 08:06:22.256148 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: Content-Type: application/json Jun 29 08:06:22.256148 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: Host: 10.222.0.43 Jun 29 08:06:22.256148 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: Openstack-System-Scope: None Jun 29 08:06:22.256148 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: User-Agent: python-urllib3/1.26.9 Jun 29 08:06:22.256148 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Auth-Token: gAAAAABivAePHe033RxOxYZwgeJ7-BqP41F5_iJwgyFr5cODuXFlqHSuk63eqBhgfBMhgDpfeg0QF5vU7SDawMJR3AbVzJ1bJvjCKuKfPZgYgjxX6jM0Vfe5rHPfvhzcr5moyuGEW3EsPOY6xmig7ORp-rZVwV4AL3UW0rT1UTpl72auJwRns4s Jun 29 08:06:22.256148 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Domain-Id: None Jun 29 08:06:22.256148 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Domain-Name: None Jun 29 08:06:22.256148 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Identity-Status: Confirmed Jun 29 08:06:22.256148 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Is-Admin-Project: True Jun 29 08:06:22.256148 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Project-Domain-Id: default Jun 29 08:06:22.256148 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Project-Domain-Name: Default Jun 29 08:06:22.256148 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Project-Id: 7bdadf97d44048c3bec51c0ae58ee4a6 Jun 29 08:06:22.256148 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Project-Name: tempest-VolumesSnapshotTestJSON-591127580 Jun 29 08:06:22.256148 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Role: member,reader Jun 29 08:06:22.256148 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Roles: member,reader Jun 29 08:06:22.258230 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/7bdadf97d44048c3bec51c0ae58ee4a6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_7bdadf97d44048c3bec51c0ae58ee4a6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/7bdadf97d44048c3bec51c0ae58ee4a6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/7bdadf97d44048c3bec51c0ae58ee4a6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Jun 29 08:06:22.258230 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Tenant: tempest-VolumesSnapshotTestJSON-591127580 Jun 29 08:06:22.258230 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Tenant-Id: 7bdadf97d44048c3bec51c0ae58ee4a6 Jun 29 08:06:22.258230 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-591127580 Jun 29 08:06:22.258230 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-User: tempest-VolumesSnapshotTestJSON-591127580-project Jun 29 08:06:22.258230 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-User-Domain-Id: default Jun 29 08:06:22.258230 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-User-Domain-Name: Default Jun 29 08:06:22.258230 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-User-Id: c1feaba97f594ffda9dd2962bebdc082 Jun 29 08:06:22.258230 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-User-Name: tempest-VolumesSnapshotTestJSON-591127580-project Jun 29 08:06:22.258230 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: method: > Jun 29 08:06:22.258230 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: exception: Instance 2e99307a-e437-4e8d-821c-319cc555e209 could not be found. Jun 29 08:06:22.258230 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: action_args: {'id': '2e99307a-e437-4e8d-821c-319cc555e209'} Jun 29 08:06:22.259220 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 08:06:22.259220 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:06:22.259220 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 29 08:06:22.259220 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 29 08:06:22.259220 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 29 08:06:22.259220 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 29 08:06:22.259220 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 29 08:06:22.259220 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 29 08:06:22.259220 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 29 08:06:22.259220 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 29 08:06:22.259220 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2e99307a-e437-4e8d-821c-319cc555e209 could not be found. Jun 29 08:06:22.259220 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 29 08:06:22.259220 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 08:06:22.259220 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 29 08:06:22.259220 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:06:22.259220 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 08:06:22.259220 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 08:06:22.259220 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 08:06:22.259220 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 08:06:22.259220 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 08:06:22.260800 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 08:06:22.260800 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 29 08:06:22.260800 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 29 08:06:22.260800 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 29 08:06:22.260800 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 29 08:06:22.260800 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 29 08:06:22.260800 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 29 08:06:22.260800 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2e99307a-e437-4e8d-821c-319cc555e209 could not be found. Jun 29 08:06:22.260800 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 29 08:06:22.260800 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 08:06:22.260800 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 29 08:06:22.260800 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:06:22.260800 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 08:06:22.260800 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 08:06:22.260800 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 08:06:22.260800 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 08:06:22.260800 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2e99307a-e437-4e8d-821c-319cc555e209 could not be found. Jun 29 08:06:22.260800 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 29 08:06:22.263180 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-1dac75f4-fd59-4972-ba25-8289e490b81d tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Returning 404 to user: Instance 2e99307a-e437-4e8d-821c-319cc555e209 could not be found. {{(pid=117890) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 08:06:22.263180 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-1dac75f4-fd59-4972-ba25-8289e490b81d tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] 10.222.0.43 "GET /compute/v2.1/servers/2e99307a-e437-4e8d-821c-319cc555e209" status: 404 len: 111 microversion: 2.1 time: 0.079044 Jun 29 08:06:22.267210 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 199/398] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:06:22 2022] GET /compute/v2.1/servers/2e99307a-e437-4e8d-821c-319cc555e209 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 29 08:06:22.411467 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-de154407-e53c-4472-a6da-bb40aa32ca6d tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de6636a0522642799e43a8f02ee602ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a20f6f9f254aae91c952ee44a4ff74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:06:22.423198 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-de154407-e53c-4472-a6da-bb40aa32ca6d tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] 10.222.0.43 "GET /compute/v2.1/servers/83a86ef0-c066-44a7-b4eb-e32dce6e0069" status: 200 len: 1260 microversion: 2.1 time: 0.379128 Jun 29 08:06:22.423811 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 200/399] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:06:22 2022] GET /compute/v2.1/servers/83a86ef0-c066-44a7-b4eb-e32dce6e0069 => generated 1260 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:06:22.640418 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [req-910f344a-8583-4fc3-9901-790f17cad53d req-82d1e037-48d7-40c8-9729-1e73079945d1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "83a86ef0-c066-44a7-b4eb-e32dce6e0069", "tag": "3828b918-ada6-49b4-b99e-2bfa66c92b2d"}]} {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:06:22.663564 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [req-910f344a-8583-4fc3-9901-790f17cad53d req-82d1e037-48d7-40c8-9729-1e73079945d1 service nova] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:22.664089 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [req-910f344a-8583-4fc3-9901-790f17cad53d req-82d1e037-48d7-40c8-9729-1e73079945d1 service nova] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:22.679808 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.compute.server_external_events [req-910f344a-8583-4fc3-9901-790f17cad53d req-82d1e037-48d7-40c8-9729-1e73079945d1 service nova] Creating event network-changed:3828b918-ada6-49b4-b99e-2bfa66c92b2d for instance 83a86ef0-c066-44a7-b4eb-e32dce6e0069 on hv-cinder-76810 Jun 29 08:06:22.694902 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [req-910f344a-8583-4fc3-9901-790f17cad53d req-82d1e037-48d7-40c8-9729-1e73079945d1 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062306 Jun 29 08:06:22.696598 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 200/400] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jun 29 08:06:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 29 08:06:23.058763 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-00567bbf-7010-43f8-b394-fb25cfc04269 tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:06:23.059407 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-00567bbf-7010-43f8-b394-fb25cfc04269 tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] [instance: 4a523b7d-76fc-4f57-9bfe-c9c2b4b0b8c8] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:06:23.066908 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-00567bbf-7010-43f8-b394-fb25cfc04269 tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:23.067378 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-00567bbf-7010-43f8-b394-fb25cfc04269 tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:23.068165 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-00567bbf-7010-43f8-b394-fb25cfc04269 tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:23.068606 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-00567bbf-7010-43f8-b394-fb25cfc04269 tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:23.202384 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-8acf2745-a833-4e90-84e3-b5255fb24ba9 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:06:23.203893 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-8acf2745-a833-4e90-84e3-b5255fb24ba9 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] [instance: f99567d1-cadf-40c5-b1dc-f86739b2b16c] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:06:23.208188 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG dbcounter [-] [117890] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=117890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:06:23.217465 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-8acf2745-a833-4e90-84e3-b5255fb24ba9 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:23.218208 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-8acf2745-a833-4e90-84e3-b5255fb24ba9 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:23.219669 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-8acf2745-a833-4e90-84e3-b5255fb24ba9 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:23.220517 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-8acf2745-a833-4e90-84e3-b5255fb24ba9 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:23.270275 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-00567bbf-7010-43f8-b394-fb25cfc04269 tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6663857e60ca4440a9a620007be4c2c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7afb1bdb06042f4b983631745f32e19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:06:23.278583 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-00567bbf-7010-43f8-b394-fb25cfc04269 tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] 10.222.0.43 "GET /compute/v2.1/servers/4a523b7d-76fc-4f57-9bfe-c9c2b4b0b8c8" status: 200 len: 1356 microversion: 2.1 time: 0.223555 Jun 29 08:06:23.288636 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 201/401] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:06:23 2022] GET /compute/v2.1/servers/4a523b7d-76fc-4f57-9bfe-c9c2b4b0b8c8 => generated 1356 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:06:23.443946 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-24957085-9af8-4923-8cf4-986efb224c64 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:06:23.444691 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-24957085-9af8-4923-8cf4-986efb224c64 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] [instance: 83a86ef0-c066-44a7-b4eb-e32dce6e0069] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:06:23.444861 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-8acf2745-a833-4e90-84e3-b5255fb24ba9 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:06:23.457862 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-24957085-9af8-4923-8cf4-986efb224c64 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:23.458610 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-24957085-9af8-4923-8cf4-986efb224c64 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:23.460340 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-24957085-9af8-4923-8cf4-986efb224c64 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:23.461041 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-8acf2745-a833-4e90-84e3-b5255fb24ba9 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:06:23.461308 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-24957085-9af8-4923-8cf4-986efb224c64 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:23.462792 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-8acf2745-a833-4e90-84e3-b5255fb24ba9 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:06:23.464488 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-8acf2745-a833-4e90-84e3-b5255fb24ba9 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] 10.222.0.43 "GET /compute/v2.1/servers/f99567d1-cadf-40c5-b1dc-f86739b2b16c" status: 200 len: 1810 microversion: 2.20 time: 0.267381 Jun 29 08:06:23.478664 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 201/402] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 29 08:06:23 2022] GET /compute/v2.1/servers/f99567d1-cadf-40c5-b1dc-f86739b2b16c => generated 1810 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:06:23.698598 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-24957085-9af8-4923-8cf4-986efb224c64 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de6636a0522642799e43a8f02ee602ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a20f6f9f254aae91c952ee44a4ff74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:06:23.708519 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-24957085-9af8-4923-8cf4-986efb224c64 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] 10.222.0.43 "GET /compute/v2.1/servers/83a86ef0-c066-44a7-b4eb-e32dce6e0069" status: 200 len: 1260 microversion: 2.1 time: 0.270210 Jun 29 08:06:23.709253 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 202/403] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:06:23 2022] GET /compute/v2.1/servers/83a86ef0-c066-44a7-b4eb-e32dce6e0069 => generated 1260 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 08:06:24.295667 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-173c0e09-eadb-490d-a1b8-57c8d542168b tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:06:24.296923 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-173c0e09-eadb-490d-a1b8-57c8d542168b tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] [instance: 4a523b7d-76fc-4f57-9bfe-c9c2b4b0b8c8] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:06:24.305205 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-173c0e09-eadb-490d-a1b8-57c8d542168b tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:24.305892 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-173c0e09-eadb-490d-a1b8-57c8d542168b tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:24.306879 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-173c0e09-eadb-490d-a1b8-57c8d542168b tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:24.307650 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-173c0e09-eadb-490d-a1b8-57c8d542168b tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:24.482152 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-173c0e09-eadb-490d-a1b8-57c8d542168b tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6663857e60ca4440a9a620007be4c2c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7afb1bdb06042f4b983631745f32e19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:06:24.491244 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-173c0e09-eadb-490d-a1b8-57c8d542168b tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] 10.222.0.43 "GET /compute/v2.1/servers/4a523b7d-76fc-4f57-9bfe-c9c2b4b0b8c8" status: 200 len: 1356 microversion: 2.1 time: 0.199314 Jun 29 08:06:24.491816 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 202/404] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:06:24 2022] GET /compute/v2.1/servers/4a523b7d-76fc-4f57-9bfe-c9c2b4b0b8c8 => generated 1356 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:06:24.499314 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-4a6889dd-edd2-41e1-8ecc-6387327c1de9 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:06:24.499769 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-4a6889dd-edd2-41e1-8ecc-6387327c1de9 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] [instance: f99567d1-cadf-40c5-b1dc-f86739b2b16c] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:06:24.507391 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-4a6889dd-edd2-41e1-8ecc-6387327c1de9 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:24.508087 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-4a6889dd-edd2-41e1-8ecc-6387327c1de9 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:24.509060 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-4a6889dd-edd2-41e1-8ecc-6387327c1de9 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:24.509709 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-4a6889dd-edd2-41e1-8ecc-6387327c1de9 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:24.514702 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:06:24.680483 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-4a6889dd-edd2-41e1-8ecc-6387327c1de9 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:06:24.696465 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-4a6889dd-edd2-41e1-8ecc-6387327c1de9 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:06:24.698087 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-4a6889dd-edd2-41e1-8ecc-6387327c1de9 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:06:24.699471 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-4a6889dd-edd2-41e1-8ecc-6387327c1de9 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] 10.222.0.43 "GET /compute/v2.1/servers/f99567d1-cadf-40c5-b1dc-f86739b2b16c" status: 200 len: 1810 microversion: 2.20 time: 0.218395 Jun 29 08:06:24.700039 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 203/405] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 29 08:06:24 2022] GET /compute/v2.1/servers/f99567d1-cadf-40c5-b1dc-f86739b2b16c => generated 1810 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:06:24.727699 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-1f3e9e77-9316-497b-bcff-3b7e2c81391c tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:06:24.728379 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-1f3e9e77-9316-497b-bcff-3b7e2c81391c tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] [instance: 83a86ef0-c066-44a7-b4eb-e32dce6e0069] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:06:24.735366 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-1f3e9e77-9316-497b-bcff-3b7e2c81391c tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:24.735655 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-1f3e9e77-9316-497b-bcff-3b7e2c81391c tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:24.736421 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-1f3e9e77-9316-497b-bcff-3b7e2c81391c tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:24.737068 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-1f3e9e77-9316-497b-bcff-3b7e2c81391c tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:24.883761 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-1f3e9e77-9316-497b-bcff-3b7e2c81391c tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de6636a0522642799e43a8f02ee602ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a20f6f9f254aae91c952ee44a4ff74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:06:24.892305 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-1f3e9e77-9316-497b-bcff-3b7e2c81391c tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] 10.222.0.43 "GET /compute/v2.1/servers/83a86ef0-c066-44a7-b4eb-e32dce6e0069" status: 200 len: 1260 microversion: 2.1 time: 0.169306 Jun 29 08:06:24.892947 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 203/406] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:06:24 2022] GET /compute/v2.1/servers/83a86ef0-c066-44a7-b4eb-e32dce6e0069 => generated 1260 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 08:06:25.514793 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-8682e821-1c8c-49ee-9935-12b8adc61c9e tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:06:25.514793 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-8682e821-1c8c-49ee-9935-12b8adc61c9e tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] [instance: 4a523b7d-76fc-4f57-9bfe-c9c2b4b0b8c8] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:06:25.527032 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-8682e821-1c8c-49ee-9935-12b8adc61c9e tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:25.527876 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-8682e821-1c8c-49ee-9935-12b8adc61c9e tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:25.529977 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-8682e821-1c8c-49ee-9935-12b8adc61c9e tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:25.529977 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-8682e821-1c8c-49ee-9935-12b8adc61c9e tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:25.724263 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-8682e821-1c8c-49ee-9935-12b8adc61c9e tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6663857e60ca4440a9a620007be4c2c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7afb1bdb06042f4b983631745f32e19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:06:25.724449 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-a12bbaff-401f-490e-a78a-765732b13c04 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:06:25.726567 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-a12bbaff-401f-490e-a78a-765732b13c04 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] [instance: f99567d1-cadf-40c5-b1dc-f86739b2b16c] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:06:25.739938 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-8682e821-1c8c-49ee-9935-12b8adc61c9e tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] 10.222.0.43 "GET /compute/v2.1/servers/4a523b7d-76fc-4f57-9bfe-c9c2b4b0b8c8" status: 200 len: 1356 microversion: 2.1 time: 0.234572 Jun 29 08:06:25.740195 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-a12bbaff-401f-490e-a78a-765732b13c04 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:25.740540 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 204/407] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:06:25 2022] GET /compute/v2.1/servers/4a523b7d-76fc-4f57-9bfe-c9c2b4b0b8c8 => generated 1356 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:06:25.740819 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-a12bbaff-401f-490e-a78a-765732b13c04 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:25.742720 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-a12bbaff-401f-490e-a78a-765732b13c04 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:25.743586 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-a12bbaff-401f-490e-a78a-765732b13c04 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:25.913340 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-74c76c50-d280-4e56-9eef-cec27c148765 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:06:25.914814 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-74c76c50-d280-4e56-9eef-cec27c148765 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] [instance: 83a86ef0-c066-44a7-b4eb-e32dce6e0069] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:06:25.925774 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-74c76c50-d280-4e56-9eef-cec27c148765 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:25.942717 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-74c76c50-d280-4e56-9eef-cec27c148765 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:25.949467 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-74c76c50-d280-4e56-9eef-cec27c148765 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:25.950002 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-74c76c50-d280-4e56-9eef-cec27c148765 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:26.084220 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-a12bbaff-401f-490e-a78a-765732b13c04 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:06:26.097345 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-a12bbaff-401f-490e-a78a-765732b13c04 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:06:26.099516 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-a12bbaff-401f-490e-a78a-765732b13c04 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:06:26.102352 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-a12bbaff-401f-490e-a78a-765732b13c04 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] 10.222.0.43 "GET /compute/v2.1/servers/f99567d1-cadf-40c5-b1dc-f86739b2b16c" status: 200 len: 1810 microversion: 2.20 time: 0.387669 Jun 29 08:06:26.103598 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 204/408] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 29 08:06:25 2022] GET /compute/v2.1/servers/f99567d1-cadf-40c5-b1dc-f86739b2b16c => generated 1810 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 29 08:06:26.239711 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-74c76c50-d280-4e56-9eef-cec27c148765 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de6636a0522642799e43a8f02ee602ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a20f6f9f254aae91c952ee44a4ff74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:06:26.247234 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-74c76c50-d280-4e56-9eef-cec27c148765 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] 10.222.0.43 "GET /compute/v2.1/servers/83a86ef0-c066-44a7-b4eb-e32dce6e0069" status: 200 len: 1260 microversion: 2.1 time: 0.341449 Jun 29 08:06:26.247814 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 205/409] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:06:25 2022] GET /compute/v2.1/servers/83a86ef0-c066-44a7-b4eb-e32dce6e0069 => generated 1260 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:06:26.757913 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-2f68c186-2920-4091-868d-42acc7ca7b48 tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:06:26.759126 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-2f68c186-2920-4091-868d-42acc7ca7b48 tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] [instance: 4a523b7d-76fc-4f57-9bfe-c9c2b4b0b8c8] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:06:26.771270 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-2f68c186-2920-4091-868d-42acc7ca7b48 tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:26.772392 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-2f68c186-2920-4091-868d-42acc7ca7b48 tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:26.773259 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-2f68c186-2920-4091-868d-42acc7ca7b48 tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:26.773702 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-2f68c186-2920-4091-868d-42acc7ca7b48 tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:26.946282 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG dbcounter [-] [117890] Writing DB stats nova_cell0:SELECT=2 {{(pid=117890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:06:26.972862 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG dbcounter [-] [117890] Writing DB stats nova_cell0:SELECT=6 {{(pid=117890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:06:27.040096 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-2f68c186-2920-4091-868d-42acc7ca7b48 tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6663857e60ca4440a9a620007be4c2c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7afb1bdb06042f4b983631745f32e19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:06:27.049168 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-2f68c186-2920-4091-868d-42acc7ca7b48 tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] 10.222.0.43 "GET /compute/v2.1/servers/4a523b7d-76fc-4f57-9bfe-c9c2b4b0b8c8" status: 200 len: 1546 microversion: 2.1 time: 0.296516 Jun 29 08:06:27.076663 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 205/410] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:06:26 2022] GET /compute/v2.1/servers/4a523b7d-76fc-4f57-9bfe-c9c2b4b0b8c8 => generated 1546 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 08:06:27.085283 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-43f0dd76-b0c4-48bb-9d57-8acacdf8cadc tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:06:27.087363 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-43f0dd76-b0c4-48bb-9d57-8acacdf8cadc tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] [instance: 4a523b7d-76fc-4f57-9bfe-c9c2b4b0b8c8] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:06:27.123568 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-5b184a77-215a-4bc2-84f2-4f27bf5eb01d tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:06:27.123828 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-43f0dd76-b0c4-48bb-9d57-8acacdf8cadc tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:27.124215 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-5b184a77-215a-4bc2-84f2-4f27bf5eb01d tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] [instance: f99567d1-cadf-40c5-b1dc-f86739b2b16c] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:06:27.124668 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-43f0dd76-b0c4-48bb-9d57-8acacdf8cadc tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:27.126147 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-43f0dd76-b0c4-48bb-9d57-8acacdf8cadc tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:27.135617 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-43f0dd76-b0c4-48bb-9d57-8acacdf8cadc tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:27.143059 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-5b184a77-215a-4bc2-84f2-4f27bf5eb01d tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:27.144882 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-5b184a77-215a-4bc2-84f2-4f27bf5eb01d tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:27.146500 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-5b184a77-215a-4bc2-84f2-4f27bf5eb01d tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:27.149356 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-5b184a77-215a-4bc2-84f2-4f27bf5eb01d tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:27.299078 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_cell0:SELECT=2 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:06:27.347150 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-5b184a77-215a-4bc2-84f2-4f27bf5eb01d tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:06:27.363285 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-5b184a77-215a-4bc2-84f2-4f27bf5eb01d tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:06:27.366189 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-5b184a77-215a-4bc2-84f2-4f27bf5eb01d tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:06:27.367930 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-5b184a77-215a-4bc2-84f2-4f27bf5eb01d tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] 10.222.0.43 "GET /compute/v2.1/servers/f99567d1-cadf-40c5-b1dc-f86739b2b16c" status: 200 len: 1810 microversion: 2.20 time: 0.248427 Jun 29 08:06:27.381705 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 206/411] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 29 08:06:27 2022] GET /compute/v2.1/servers/f99567d1-cadf-40c5-b1dc-f86739b2b16c => generated 1810 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 29 08:06:27.386952 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-35035d21-f8ec-4304-afff-3e8a6d26930e tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:06:27.387761 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-35035d21-f8ec-4304-afff-3e8a6d26930e tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] [instance: 83a86ef0-c066-44a7-b4eb-e32dce6e0069] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:06:27.395738 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-35035d21-f8ec-4304-afff-3e8a6d26930e tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:27.396184 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-35035d21-f8ec-4304-afff-3e8a6d26930e tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:27.396959 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-35035d21-f8ec-4304-afff-3e8a6d26930e tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:27.397415 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-35035d21-f8ec-4304-afff-3e8a6d26930e tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:27.409289 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-43f0dd76-b0c4-48bb-9d57-8acacdf8cadc tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6663857e60ca4440a9a620007be4c2c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7afb1bdb06042f4b983631745f32e19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:06:27.417007 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-43f0dd76-b0c4-48bb-9d57-8acacdf8cadc tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] 10.222.0.43 "GET /compute/v2.1/servers/4a523b7d-76fc-4f57-9bfe-c9c2b4b0b8c8" status: 200 len: 1546 microversion: 2.1 time: 0.338363 Jun 29 08:06:27.417575 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 206/412] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:06:27 2022] GET /compute/v2.1/servers/4a523b7d-76fc-4f57-9bfe-c9c2b4b0b8c8 => generated 1546 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:06:27.433726 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-d8ab4291-fbee-4efd-ad08-422326dbcd5f tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:06:27.437565 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-d8ab4291-fbee-4efd-ad08-422326dbcd5f tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6663857e60ca4440a9a620007be4c2c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7afb1bdb06042f4b983631745f32e19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:06:27.439516 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-d8ab4291-fbee-4efd-ad08-422326dbcd5f tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Searching by: {'deleted': False, 'project_id': 'a7afb1bdb06042f4b983631745f32e19'} {{(pid=117889) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 29 08:06:27.447229 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-d8ab4291-fbee-4efd-ad08-422326dbcd5f tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:27.447848 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-d8ab4291-fbee-4efd-ad08-422326dbcd5f tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:27.448647 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-d8ab4291-fbee-4efd-ad08-422326dbcd5f tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:27.449531 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-d8ab4291-fbee-4efd-ad08-422326dbcd5f tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:27.599520 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-35035d21-f8ec-4304-afff-3e8a6d26930e tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de6636a0522642799e43a8f02ee602ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a20f6f9f254aae91c952ee44a4ff74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:06:27.600856 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.multi_cell_list [None req-d8ab4291-fbee-4efd-ad08-422326dbcd5f tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=117889) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 29 08:06:27.613894 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-35035d21-f8ec-4304-afff-3e8a6d26930e tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] 10.222.0.43 "GET /compute/v2.1/servers/83a86ef0-c066-44a7-b4eb-e32dce6e0069" status: 200 len: 1260 microversion: 2.1 time: 0.230833 Jun 29 08:06:27.615189 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 207/413] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:06:27 2022] GET /compute/v2.1/servers/83a86ef0-c066-44a7-b4eb-e32dce6e0069 => generated 1260 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:06:27.766357 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-d8ab4291-fbee-4efd-ad08-422326dbcd5f tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] 10.222.0.43 "GET /compute/v2.1/servers" status: 200 len: 341 microversion: 2.1 time: 0.336427 Jun 29 08:06:27.768309 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 207/414] 10.222.0.43 () {58 vars in 1124 bytes} [Wed Jun 29 08:06:27 2022] GET /compute/v2.1/servers => generated 341 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 29 08:06:27.779138 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-109a910f-e380-435e-9429-cab0841d283b tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:06:27.780509 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-109a910f-e380-435e-9429-cab0841d283b tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] [instance: 4a523b7d-76fc-4f57-9bfe-c9c2b4b0b8c8] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:06:27.799754 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-109a910f-e380-435e-9429-cab0841d283b tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:27.800856 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-109a910f-e380-435e-9429-cab0841d283b tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:27.801915 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-109a910f-e380-435e-9429-cab0841d283b tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:27.802359 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-109a910f-e380-435e-9429-cab0841d283b tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:28.034035 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-109a910f-e380-435e-9429-cab0841d283b tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6663857e60ca4440a9a620007be4c2c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7afb1bdb06042f4b983631745f32e19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:06:28.044016 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-109a910f-e380-435e-9429-cab0841d283b tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] 10.222.0.43 "GET /compute/v2.1/servers/4a523b7d-76fc-4f57-9bfe-c9c2b4b0b8c8" status: 200 len: 1546 microversion: 2.1 time: 0.268564 Jun 29 08:06:28.044664 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 208/415] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:06:27 2022] GET /compute/v2.1/servers/4a523b7d-76fc-4f57-9bfe-c9c2b4b0b8c8 => generated 1546 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:06:28.395574 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-da3077f1-0ef4-4c65-902d-7963ee51e4c4 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:06:28.396377 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-da3077f1-0ef4-4c65-902d-7963ee51e4c4 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] [instance: f99567d1-cadf-40c5-b1dc-f86739b2b16c] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:06:28.415973 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-da3077f1-0ef4-4c65-902d-7963ee51e4c4 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:28.422322 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-da3077f1-0ef4-4c65-902d-7963ee51e4c4 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:28.425342 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-da3077f1-0ef4-4c65-902d-7963ee51e4c4 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:28.427927 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-da3077f1-0ef4-4c65-902d-7963ee51e4c4 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:28.640531 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-4dd676a2-c5eb-4a7e-96a4-e167d41a4703 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:06:28.640778 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-4dd676a2-c5eb-4a7e-96a4-e167d41a4703 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] [instance: 83a86ef0-c066-44a7-b4eb-e32dce6e0069] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:06:28.648530 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-4dd676a2-c5eb-4a7e-96a4-e167d41a4703 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:28.649670 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-4dd676a2-c5eb-4a7e-96a4-e167d41a4703 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:28.651451 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-4dd676a2-c5eb-4a7e-96a4-e167d41a4703 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:28.652226 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-4dd676a2-c5eb-4a7e-96a4-e167d41a4703 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:28.747593 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-da3077f1-0ef4-4c65-902d-7963ee51e4c4 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:06:28.758268 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-da3077f1-0ef4-4c65-902d-7963ee51e4c4 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:06:28.759870 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-da3077f1-0ef4-4c65-902d-7963ee51e4c4 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:06:28.761159 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-da3077f1-0ef4-4c65-902d-7963ee51e4c4 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] 10.222.0.43 "GET /compute/v2.1/servers/f99567d1-cadf-40c5-b1dc-f86739b2b16c" status: 200 len: 1810 microversion: 2.20 time: 0.377449 Jun 29 08:06:28.774344 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 208/416] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 29 08:06:28 2022] GET /compute/v2.1/servers/f99567d1-cadf-40c5-b1dc-f86739b2b16c => generated 1810 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:06:28.890345 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-4dd676a2-c5eb-4a7e-96a4-e167d41a4703 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de6636a0522642799e43a8f02ee602ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a20f6f9f254aae91c952ee44a4ff74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:06:28.902846 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-4dd676a2-c5eb-4a7e-96a4-e167d41a4703 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] 10.222.0.43 "GET /compute/v2.1/servers/83a86ef0-c066-44a7-b4eb-e32dce6e0069" status: 200 len: 1260 microversion: 2.1 time: 0.266536 Jun 29 08:06:28.903587 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 209/417] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:06:28 2022] GET /compute/v2.1/servers/83a86ef0-c066-44a7-b4eb-e32dce6e0069 => generated 1260 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 08:06:29.788684 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-2c70fd34-5e57-4ac1-a067-008c6cde681e tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:06:29.792784 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-2c70fd34-5e57-4ac1-a067-008c6cde681e tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] [instance: f99567d1-cadf-40c5-b1dc-f86739b2b16c] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:06:29.805904 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-2c70fd34-5e57-4ac1-a067-008c6cde681e tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:29.806501 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-2c70fd34-5e57-4ac1-a067-008c6cde681e tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:29.807417 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-2c70fd34-5e57-4ac1-a067-008c6cde681e tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:29.807926 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-2c70fd34-5e57-4ac1-a067-008c6cde681e tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:29.936871 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-709dc5cd-4829-4077-927e-4e271f3a523f tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:06:29.939409 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-709dc5cd-4829-4077-927e-4e271f3a523f tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] [instance: 83a86ef0-c066-44a7-b4eb-e32dce6e0069] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:06:29.951949 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-709dc5cd-4829-4077-927e-4e271f3a523f tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:29.953271 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-709dc5cd-4829-4077-927e-4e271f3a523f tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:29.954578 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-709dc5cd-4829-4077-927e-4e271f3a523f tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:29.955240 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-709dc5cd-4829-4077-927e-4e271f3a523f tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:29.964721 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-2c70fd34-5e57-4ac1-a067-008c6cde681e tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:06:29.975270 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-2c70fd34-5e57-4ac1-a067-008c6cde681e tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:06:29.976812 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-2c70fd34-5e57-4ac1-a067-008c6cde681e tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:06:29.980830 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-2c70fd34-5e57-4ac1-a067-008c6cde681e tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] 10.222.0.43 "GET /compute/v2.1/servers/f99567d1-cadf-40c5-b1dc-f86739b2b16c" status: 200 len: 1810 microversion: 2.20 time: 0.199240 Jun 29 08:06:29.980830 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 209/418] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 29 08:06:29 2022] GET /compute/v2.1/servers/f99567d1-cadf-40c5-b1dc-f86739b2b16c => generated 1810 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:06:30.131888 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-709dc5cd-4829-4077-927e-4e271f3a523f tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de6636a0522642799e43a8f02ee602ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a20f6f9f254aae91c952ee44a4ff74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:06:30.145856 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-709dc5cd-4829-4077-927e-4e271f3a523f tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] 10.222.0.43 "GET /compute/v2.1/servers/83a86ef0-c066-44a7-b4eb-e32dce6e0069" status: 200 len: 1260 microversion: 2.1 time: 0.224024 Jun 29 08:06:30.157377 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 210/419] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:06:29 2022] GET /compute/v2.1/servers/83a86ef0-c066-44a7-b4eb-e32dce6e0069 => generated 1260 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:06:31.000431 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-46d5f9fe-cfd4-49aa-a461-e6fcdcecb599 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:06:31.002305 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-46d5f9fe-cfd4-49aa-a461-e6fcdcecb599 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] [instance: f99567d1-cadf-40c5-b1dc-f86739b2b16c] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:06:31.010993 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-46d5f9fe-cfd4-49aa-a461-e6fcdcecb599 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:31.011512 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-46d5f9fe-cfd4-49aa-a461-e6fcdcecb599 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:31.012927 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-46d5f9fe-cfd4-49aa-a461-e6fcdcecb599 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:31.013394 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-46d5f9fe-cfd4-49aa-a461-e6fcdcecb599 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:31.171295 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-b598b254-4fc8-48e3-a091-23944dabd90b tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:06:31.172392 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-b598b254-4fc8-48e3-a091-23944dabd90b tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] [instance: 83a86ef0-c066-44a7-b4eb-e32dce6e0069] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:06:31.182059 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-b598b254-4fc8-48e3-a091-23944dabd90b tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:31.182512 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-b598b254-4fc8-48e3-a091-23944dabd90b tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:31.183301 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-b598b254-4fc8-48e3-a091-23944dabd90b tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:31.183740 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-b598b254-4fc8-48e3-a091-23944dabd90b tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:31.193660 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-46d5f9fe-cfd4-49aa-a461-e6fcdcecb599 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:06:31.202933 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-46d5f9fe-cfd4-49aa-a461-e6fcdcecb599 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:06:31.205066 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-46d5f9fe-cfd4-49aa-a461-e6fcdcecb599 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:06:31.206505 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-46d5f9fe-cfd4-49aa-a461-e6fcdcecb599 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] 10.222.0.43 "GET /compute/v2.1/servers/f99567d1-cadf-40c5-b1dc-f86739b2b16c" status: 200 len: 1810 microversion: 2.20 time: 0.210903 Jun 29 08:06:31.207080 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 210/420] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 29 08:06:30 2022] GET /compute/v2.1/servers/f99567d1-cadf-40c5-b1dc-f86739b2b16c => generated 1810 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:06:31.363858 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-b598b254-4fc8-48e3-a091-23944dabd90b tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de6636a0522642799e43a8f02ee602ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a20f6f9f254aae91c952ee44a4ff74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:06:31.371541 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-b598b254-4fc8-48e3-a091-23944dabd90b tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] 10.222.0.43 "GET /compute/v2.1/servers/83a86ef0-c066-44a7-b4eb-e32dce6e0069" status: 200 len: 1260 microversion: 2.1 time: 0.206833 Jun 29 08:06:31.372117 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 211/421] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:06:31 2022] GET /compute/v2.1/servers/83a86ef0-c066-44a7-b4eb-e32dce6e0069 => generated 1260 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:06:32.225156 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-6d55a7af-4c74-4fe5-8b96-722146c451d7 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:06:32.225762 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-6d55a7af-4c74-4fe5-8b96-722146c451d7 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] [instance: f99567d1-cadf-40c5-b1dc-f86739b2b16c] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:06:32.228262 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_api:SELECT=88 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:06:32.233903 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-6d55a7af-4c74-4fe5-8b96-722146c451d7 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:32.234348 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-6d55a7af-4c74-4fe5-8b96-722146c451d7 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:32.235115 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-6d55a7af-4c74-4fe5-8b96-722146c451d7 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:32.236188 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-6d55a7af-4c74-4fe5-8b96-722146c451d7 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:32.388862 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-b2e5a7c6-9b49-4eb4-929d-41ed0d7ad982 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:06:32.389778 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-b2e5a7c6-9b49-4eb4-929d-41ed0d7ad982 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] [instance: 83a86ef0-c066-44a7-b4eb-e32dce6e0069] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:06:32.397571 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-b2e5a7c6-9b49-4eb4-929d-41ed0d7ad982 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:32.398111 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-b2e5a7c6-9b49-4eb4-929d-41ed0d7ad982 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:32.399047 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-b2e5a7c6-9b49-4eb4-929d-41ed0d7ad982 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:32.399567 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-b2e5a7c6-9b49-4eb4-929d-41ed0d7ad982 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:32.413090 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-6d55a7af-4c74-4fe5-8b96-722146c451d7 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:06:32.430632 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-6d55a7af-4c74-4fe5-8b96-722146c451d7 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:06:32.432741 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-6d55a7af-4c74-4fe5-8b96-722146c451d7 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:06:32.434481 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-6d55a7af-4c74-4fe5-8b96-722146c451d7 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] 10.222.0.43 "GET /compute/v2.1/servers/f99567d1-cadf-40c5-b1dc-f86739b2b16c" status: 200 len: 1810 microversion: 2.20 time: 0.213240 Jun 29 08:06:32.445959 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 211/422] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 29 08:06:32 2022] GET /compute/v2.1/servers/f99567d1-cadf-40c5-b1dc-f86739b2b16c => generated 1810 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:06:32.592683 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-b2e5a7c6-9b49-4eb4-929d-41ed0d7ad982 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de6636a0522642799e43a8f02ee602ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a20f6f9f254aae91c952ee44a4ff74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:06:32.610218 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-b2e5a7c6-9b49-4eb4-929d-41ed0d7ad982 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] 10.222.0.43 "GET /compute/v2.1/servers/83a86ef0-c066-44a7-b4eb-e32dce6e0069" status: 200 len: 1260 microversion: 2.1 time: 0.224353 Jun 29 08:06:32.635537 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 212/423] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:06:32 2022] GET /compute/v2.1/servers/83a86ef0-c066-44a7-b4eb-e32dce6e0069 => generated 1260 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 08:06:32.818234 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-f72f50a5-86c5-474a-9982-448193f371ac tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1832636182", "imageRef": "5d2148a0-3628-4eff-88e9-5686abc0d33e", "flavorRef": "452", "networks": [{"uuid": "bb0ac50d-f096-456e-83b5-ef7555b20457"}]}} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:06:32.901496 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.network.neutron [None req-f72f50a5-86c5-474a-9982-448193f371ac tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] validate_networks() for [('bb0ac50d-f096-456e-83b5-ef7555b20457', None, None, None, None, None)] {{(pid=117889) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 29 08:06:33.055343 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-17d6717a-47db-4f36-b7bc-b17936a0981b tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7363efa8-bbb9-40df-ad0d-09478e0bc426"}} {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:06:33.057040 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-17d6717a-47db-4f36-b7bc-b17936a0981b tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] [instance: 4a523b7d-76fc-4f57-9bfe-c9c2b4b0b8c8] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:06:33.065543 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-17d6717a-47db-4f36-b7bc-b17936a0981b tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:33.066402 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-17d6717a-47db-4f36-b7bc-b17936a0981b tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:33.067448 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-17d6717a-47db-4f36-b7bc-b17936a0981b tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:33.068124 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-17d6717a-47db-4f36-b7bc-b17936a0981b tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:33.662356 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.virt.hardware [None req-f72f50a5-86c5-474a-9982-448193f371ac tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Flavor limits 0:0:0 {{(pid=117889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 29 08:06:33.663131 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.virt.hardware [None req-f72f50a5-86c5-474a-9982-448193f371ac tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Image limits 0:0:0 {{(pid=117889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 29 08:06:33.663993 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.virt.hardware [None req-f72f50a5-86c5-474a-9982-448193f371ac tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Flavor pref 0:0:0 {{(pid=117889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 29 08:06:33.664770 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.virt.hardware [None req-f72f50a5-86c5-474a-9982-448193f371ac tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Image pref 0:0:0 {{(pid=117889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 29 08:06:33.665827 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.virt.hardware [None req-f72f50a5-86c5-474a-9982-448193f371ac tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 29 08:06:33.682614 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-f72f50a5-86c5-474a-9982-448193f371ac tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:33.683462 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-f72f50a5-86c5-474a-9982-448193f371ac tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:33.684928 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-f72f50a5-86c5-474a-9982-448193f371ac tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:33.685798 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-f72f50a5-86c5-474a-9982-448193f371ac tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:33.714889 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.quota [None req-f72f50a5-86c5-474a-9982-448193f371ac tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Getting quotas for project 7bdadf97d44048c3bec51c0ae58ee4a6. Resources: {'ram', 'instances', 'cores'} {{(pid=117889) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 29 08:06:33.722565 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.quota [None req-f72f50a5-86c5-474a-9982-448193f371ac tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Getting quotas for user c1feaba97f594ffda9dd2962bebdc082 and project 7bdadf97d44048c3bec51c0ae58ee4a6. Resources: {'ram', 'instances', 'cores'} {{(pid=117889) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 29 08:06:33.735424 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-f72f50a5-86c5-474a-9982-448193f371ac tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Going to run 1 instances... {{(pid=117889) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 29 08:06:33.737871 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-f72f50a5-86c5-474a-9982-448193f371ac tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] [instance: c6c089a8-9bde-42b2-aa4e-014dcc9a6a30] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5d2148a0-3628-4eff-88e9-5686abc0d33e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117889) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 29 08:06:33.795911 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-f72f50a5-86c5-474a-9982-448193f371ac tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.997291 Jun 29 08:06:33.796803 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 212/424] 10.222.0.43 () {60 vars in 1146 bytes} [Wed Jun 29 08:06:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 1000 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 29 08:06:33.805584 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-7da384d0-978e-4672-b4af-cdab1b3e5920 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:06:33.806413 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-7da384d0-978e-4672-b4af-cdab1b3e5920 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] [instance: f99567d1-cadf-40c5-b1dc-f86739b2b16c] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:06:33.815575 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-7da384d0-978e-4672-b4af-cdab1b3e5920 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:33.816145 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-7da384d0-978e-4672-b4af-cdab1b3e5920 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:33.817331 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-7da384d0-978e-4672-b4af-cdab1b3e5920 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:33.817972 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-7da384d0-978e-4672-b4af-cdab1b3e5920 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:34.059029 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-7da384d0-978e-4672-b4af-cdab1b3e5920 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:06:34.073747 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-7da384d0-978e-4672-b4af-cdab1b3e5920 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:06:34.085211 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-7da384d0-978e-4672-b4af-cdab1b3e5920 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:06:34.087704 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-7da384d0-978e-4672-b4af-cdab1b3e5920 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] 10.222.0.43 "GET /compute/v2.1/servers/f99567d1-cadf-40c5-b1dc-f86739b2b16c" status: 200 len: 1810 microversion: 2.20 time: 0.289392 Jun 29 08:06:34.088939 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 213/425] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 29 08:06:33 2022] GET /compute/v2.1/servers/f99567d1-cadf-40c5-b1dc-f86739b2b16c => generated 1810 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:06:34.115298 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-3b79230d-cc75-4238-ae99-fe183896c577 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:06:34.115749 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-3b79230d-cc75-4238-ae99-fe183896c577 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] [instance: 83a86ef0-c066-44a7-b4eb-e32dce6e0069] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:06:34.136299 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-3b79230d-cc75-4238-ae99-fe183896c577 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:34.137094 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-3b79230d-cc75-4238-ae99-fe183896c577 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:34.138199 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-3b79230d-cc75-4238-ae99-fe183896c577 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:34.143506 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-3b79230d-cc75-4238-ae99-fe183896c577 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:34.381075 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-3b79230d-cc75-4238-ae99-fe183896c577 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de6636a0522642799e43a8f02ee602ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a20f6f9f254aae91c952ee44a4ff74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:06:34.400183 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-3b79230d-cc75-4238-ae99-fe183896c577 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] 10.222.0.43 "GET /compute/v2.1/servers/83a86ef0-c066-44a7-b4eb-e32dce6e0069" status: 200 len: 1260 microversion: 2.1 time: 0.290708 Jun 29 08:06:34.411516 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 214/426] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:06:34 2022] GET /compute/v2.1/servers/83a86ef0-c066-44a7-b4eb-e32dce6e0069 => generated 1260 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:06:34.416568 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-0993bd43-41bf-4b28-b34a-0ce1d6954d82 tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:06:34.417261 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-0993bd43-41bf-4b28-b34a-0ce1d6954d82 tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] [instance: c6c089a8-9bde-42b2-aa4e-014dcc9a6a30] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:06:34.524918 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-0993bd43-41bf-4b28-b34a-0ce1d6954d82 tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1feaba97f594ffda9dd2962bebdc082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdadf97d44048c3bec51c0ae58ee4a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:06:34.534789 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-0993bd43-41bf-4b28-b34a-0ce1d6954d82 tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] 10.222.0.43 "GET /compute/v2.1/servers/c6c089a8-9bde-42b2-aa4e-014dcc9a6a30" status: 200 len: 1219 microversion: 2.1 time: 0.122005 Jun 29 08:06:34.536080 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 215/427] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:06:34 2022] GET /compute/v2.1/servers/c6c089a8-9bde-42b2-aa4e-014dcc9a6a30 => generated 1219 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:06:35.121783 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-0c6ffc90-535f-47f7-9f6e-4c0549db4e7f tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:06:35.122934 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-0c6ffc90-535f-47f7-9f6e-4c0549db4e7f tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] [instance: f99567d1-cadf-40c5-b1dc-f86739b2b16c] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:06:35.137844 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-0c6ffc90-535f-47f7-9f6e-4c0549db4e7f tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:35.138469 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-0c6ffc90-535f-47f7-9f6e-4c0549db4e7f tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:35.140028 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-0c6ffc90-535f-47f7-9f6e-4c0549db4e7f tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:35.141016 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-0c6ffc90-535f-47f7-9f6e-4c0549db4e7f tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:35.397962 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-0c6ffc90-535f-47f7-9f6e-4c0549db4e7f tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:06:35.421397 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-0c6ffc90-535f-47f7-9f6e-4c0549db4e7f tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:06:35.428638 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-0c6ffc90-535f-47f7-9f6e-4c0549db4e7f tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:06:35.431306 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-0c6ffc90-535f-47f7-9f6e-4c0549db4e7f tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] 10.222.0.43 "GET /compute/v2.1/servers/f99567d1-cadf-40c5-b1dc-f86739b2b16c" status: 200 len: 1810 microversion: 2.20 time: 0.318313 Jun 29 08:06:35.433270 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 216/428] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 29 08:06:35 2022] GET /compute/v2.1/servers/f99567d1-cadf-40c5-b1dc-f86739b2b16c => generated 1810 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 29 08:06:35.457104 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-eee7c783-63f5-4d9f-8ec3-cd2bfb4ec01b tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:06:35.458249 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-eee7c783-63f5-4d9f-8ec3-cd2bfb4ec01b tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] [instance: 83a86ef0-c066-44a7-b4eb-e32dce6e0069] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:06:35.472742 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-eee7c783-63f5-4d9f-8ec3-cd2bfb4ec01b tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:35.473603 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-eee7c783-63f5-4d9f-8ec3-cd2bfb4ec01b tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:35.475141 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-eee7c783-63f5-4d9f-8ec3-cd2bfb4ec01b tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:35.475816 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-eee7c783-63f5-4d9f-8ec3-cd2bfb4ec01b tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:35.797350 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-eee7c783-63f5-4d9f-8ec3-cd2bfb4ec01b tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de6636a0522642799e43a8f02ee602ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a20f6f9f254aae91c952ee44a4ff74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:06:35.816052 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-eee7c783-63f5-4d9f-8ec3-cd2bfb4ec01b tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] 10.222.0.43 "GET /compute/v2.1/servers/83a86ef0-c066-44a7-b4eb-e32dce6e0069" status: 200 len: 1260 microversion: 2.1 time: 0.379729 Jun 29 08:06:35.817744 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 217/429] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:06:35 2022] GET /compute/v2.1/servers/83a86ef0-c066-44a7-b4eb-e32dce6e0069 => generated 1260 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:06:35.826634 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-372c59dc-d4c5-44d4-afde-f37b6b2b958d tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:06:35.827477 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-372c59dc-d4c5-44d4-afde-f37b6b2b958d tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] [instance: c6c089a8-9bde-42b2-aa4e-014dcc9a6a30] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:06:35.837027 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-372c59dc-d4c5-44d4-afde-f37b6b2b958d tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:35.837881 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-372c59dc-d4c5-44d4-afde-f37b6b2b958d tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:35.838801 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-372c59dc-d4c5-44d4-afde-f37b6b2b958d tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:35.839354 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-372c59dc-d4c5-44d4-afde-f37b6b2b958d tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:35.946578 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-372c59dc-d4c5-44d4-afde-f37b6b2b958d tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1feaba97f594ffda9dd2962bebdc082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdadf97d44048c3bec51c0ae58ee4a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:06:35.965791 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-372c59dc-d4c5-44d4-afde-f37b6b2b958d tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] 10.222.0.43 "GET /compute/v2.1/servers/c6c089a8-9bde-42b2-aa4e-014dcc9a6a30" status: 200 len: 1223 microversion: 2.1 time: 0.145424 Jun 29 08:06:35.969194 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 218/430] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:06:35 2022] GET /compute/v2.1/servers/c6c089a8-9bde-42b2-aa4e-014dcc9a6a30 => generated 1223 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:06:36.457028 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-6c5db68a-80b9-4773-8534-9e39e6c715e7 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:06:36.458156 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-6c5db68a-80b9-4773-8534-9e39e6c715e7 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] [instance: f99567d1-cadf-40c5-b1dc-f86739b2b16c] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:06:36.469334 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-6c5db68a-80b9-4773-8534-9e39e6c715e7 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:36.471194 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-6c5db68a-80b9-4773-8534-9e39e6c715e7 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:36.472269 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-6c5db68a-80b9-4773-8534-9e39e6c715e7 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:36.472777 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-6c5db68a-80b9-4773-8534-9e39e6c715e7 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:36.695377 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-6c5db68a-80b9-4773-8534-9e39e6c715e7 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:06:36.706597 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-6c5db68a-80b9-4773-8534-9e39e6c715e7 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:06:36.708280 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-6c5db68a-80b9-4773-8534-9e39e6c715e7 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:06:36.709876 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-6c5db68a-80b9-4773-8534-9e39e6c715e7 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] 10.222.0.43 "GET /compute/v2.1/servers/f99567d1-cadf-40c5-b1dc-f86739b2b16c" status: 200 len: 1810 microversion: 2.20 time: 0.260988 Jun 29 08:06:36.710469 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 219/431] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 29 08:06:36 2022] GET /compute/v2.1/servers/f99567d1-cadf-40c5-b1dc-f86739b2b16c => generated 1810 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:06:36.835111 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-a616d42f-956f-49e1-a8e9-2b21ec0c1197 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:06:36.836420 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-a616d42f-956f-49e1-a8e9-2b21ec0c1197 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] [instance: 83a86ef0-c066-44a7-b4eb-e32dce6e0069] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:06:36.844606 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-a616d42f-956f-49e1-a8e9-2b21ec0c1197 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:36.846071 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-a616d42f-956f-49e1-a8e9-2b21ec0c1197 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:36.848058 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-a616d42f-956f-49e1-a8e9-2b21ec0c1197 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:36.849198 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-a616d42f-956f-49e1-a8e9-2b21ec0c1197 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:37.169748 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-a616d42f-956f-49e1-a8e9-2b21ec0c1197 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de6636a0522642799e43a8f02ee602ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a20f6f9f254aae91c952ee44a4ff74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:06:37.188500 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-a616d42f-956f-49e1-a8e9-2b21ec0c1197 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] 10.222.0.43 "GET /compute/v2.1/servers/83a86ef0-c066-44a7-b4eb-e32dce6e0069" status: 200 len: 1260 microversion: 2.1 time: 0.356794 Jun 29 08:06:37.206869 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 220/432] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:06:36 2022] GET /compute/v2.1/servers/83a86ef0-c066-44a7-b4eb-e32dce6e0069 => generated 1260 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:06:37.225665 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-5ab4e6b1-4c49-4ee4-b4c2-13176b90b165 tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:06:37.226712 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-5ab4e6b1-4c49-4ee4-b4c2-13176b90b165 tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] [instance: c6c089a8-9bde-42b2-aa4e-014dcc9a6a30] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:06:37.238047 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-5ab4e6b1-4c49-4ee4-b4c2-13176b90b165 tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:37.238995 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-5ab4e6b1-4c49-4ee4-b4c2-13176b90b165 tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:37.240679 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-5ab4e6b1-4c49-4ee4-b4c2-13176b90b165 tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:37.241588 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-5ab4e6b1-4c49-4ee4-b4c2-13176b90b165 tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:37.255192 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_cell1:SELECT=100 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:06:37.382787 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-5ab4e6b1-4c49-4ee4-b4c2-13176b90b165 tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1feaba97f594ffda9dd2962bebdc082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdadf97d44048c3bec51c0ae58ee4a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:06:37.397385 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-5ab4e6b1-4c49-4ee4-b4c2-13176b90b165 tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] 10.222.0.43 "GET /compute/v2.1/servers/c6c089a8-9bde-42b2-aa4e-014dcc9a6a30" status: 200 len: 1223 microversion: 2.1 time: 0.186865 Jun 29 08:06:37.398409 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 221/433] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:06:37 2022] GET /compute/v2.1/servers/c6c089a8-9bde-42b2-aa4e-014dcc9a6a30 => generated 1223 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:06:37.738700 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-320555f8-b729-46a3-8d00-ff282d0e25da tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:06:37.739707 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-320555f8-b729-46a3-8d00-ff282d0e25da tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] [instance: f99567d1-cadf-40c5-b1dc-f86739b2b16c] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:06:37.756146 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-320555f8-b729-46a3-8d00-ff282d0e25da tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:37.757097 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-320555f8-b729-46a3-8d00-ff282d0e25da tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:37.758663 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-320555f8-b729-46a3-8d00-ff282d0e25da tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:37.759437 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-320555f8-b729-46a3-8d00-ff282d0e25da tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:38.023341 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-320555f8-b729-46a3-8d00-ff282d0e25da tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:06:38.042458 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-320555f8-b729-46a3-8d00-ff282d0e25da tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:06:38.045678 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-320555f8-b729-46a3-8d00-ff282d0e25da tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:06:38.048616 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-320555f8-b729-46a3-8d00-ff282d0e25da tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] 10.222.0.43 "GET /compute/v2.1/servers/f99567d1-cadf-40c5-b1dc-f86739b2b16c" status: 200 len: 1810 microversion: 2.20 time: 0.321554 Jun 29 08:06:38.050388 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 222/434] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 29 08:06:37 2022] GET /compute/v2.1/servers/f99567d1-cadf-40c5-b1dc-f86739b2b16c => generated 1810 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:06:38.227827 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-6f38a279-b04f-4872-af7d-879a322cdd7c tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:06:38.231315 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-6f38a279-b04f-4872-af7d-879a322cdd7c tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] [instance: 83a86ef0-c066-44a7-b4eb-e32dce6e0069] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:06:38.244601 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-6f38a279-b04f-4872-af7d-879a322cdd7c tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:38.246641 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-6f38a279-b04f-4872-af7d-879a322cdd7c tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:38.251522 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-6f38a279-b04f-4872-af7d-879a322cdd7c tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:38.253149 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-6f38a279-b04f-4872-af7d-879a322cdd7c tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:38.610016 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-6f38a279-b04f-4872-af7d-879a322cdd7c tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de6636a0522642799e43a8f02ee602ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a20f6f9f254aae91c952ee44a4ff74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:06:38.622329 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-6f38a279-b04f-4872-af7d-879a322cdd7c tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] 10.222.0.43 "GET /compute/v2.1/servers/83a86ef0-c066-44a7-b4eb-e32dce6e0069" status: 200 len: 1260 microversion: 2.1 time: 0.410917 Jun 29 08:06:38.623259 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 223/435] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:06:38 2022] GET /compute/v2.1/servers/83a86ef0-c066-44a7-b4eb-e32dce6e0069 => generated 1260 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 08:06:38.629352 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-33e6181e-754f-4a05-ac49-9c927fa6e937 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:06:38.629871 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-33e6181e-754f-4a05-ac49-9c927fa6e937 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] [instance: d5d97f9b-3f4a-4a5e-89e8-98d55412fe71] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:06:38.650271 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-33e6181e-754f-4a05-ac49-9c927fa6e937 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:38.654108 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-33e6181e-754f-4a05-ac49-9c927fa6e937 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:38.655275 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-33e6181e-754f-4a05-ac49-9c927fa6e937 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:38.655736 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-33e6181e-754f-4a05-ac49-9c927fa6e937 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:38.859612 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.objects.instance [None req-33e6181e-754f-4a05-ac49-9c927fa6e937 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lazy-loading 'services' on Instance uuid d5d97f9b-3f4a-4a5e-89e8-98d55412fe71 {{(pid=117889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 29 08:06:39.068000 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-33e6181e-754f-4a05-ac49-9c927fa6e937 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] 10.222.0.43 "DELETE /compute/v2.1/servers/d5d97f9b-3f4a-4a5e-89e8-98d55412fe71/os-volume_attachments/81101dbd-fd70-4464-9dba-c192c718e8ab" status: 202 len: 0 microversion: 2.1 time: 0.442804 Jun 29 08:06:39.069663 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 224/436] 10.222.0.43 () {58 vars in 1415 bytes} [Wed Jun 29 08:06:38 2022] DELETE /compute/v2.1/servers/d5d97f9b-3f4a-4a5e-89e8-98d55412fe71/os-volume_attachments/81101dbd-fd70-4464-9dba-c192c718e8ab => generated 0 bytes in 446 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 29 08:06:39.081312 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-b32a29d3-4edc-4a40-b195-f6d38cd8b224 tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:06:39.082661 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-b32a29d3-4edc-4a40-b195-f6d38cd8b224 tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] [instance: c6c089a8-9bde-42b2-aa4e-014dcc9a6a30] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:06:39.093582 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-b32a29d3-4edc-4a40-b195-f6d38cd8b224 tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:39.095490 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-b32a29d3-4edc-4a40-b195-f6d38cd8b224 tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:39.097661 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-b32a29d3-4edc-4a40-b195-f6d38cd8b224 tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:39.098648 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-b32a29d3-4edc-4a40-b195-f6d38cd8b224 tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:39.215664 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-b32a29d3-4edc-4a40-b195-f6d38cd8b224 tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1feaba97f594ffda9dd2962bebdc082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdadf97d44048c3bec51c0ae58ee4a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:06:39.224185 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-b32a29d3-4edc-4a40-b195-f6d38cd8b224 tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] 10.222.0.43 "GET /compute/v2.1/servers/c6c089a8-9bde-42b2-aa4e-014dcc9a6a30" status: 200 len: 1223 microversion: 2.1 time: 0.152176 Jun 29 08:06:39.224784 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 225/437] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:06:39 2022] GET /compute/v2.1/servers/c6c089a8-9bde-42b2-aa4e-014dcc9a6a30 => generated 1223 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:06:39.229692 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-f7526bb4-1918-435e-9516-bf92f704d121 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:06:39.230341 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-f7526bb4-1918-435e-9516-bf92f704d121 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] [instance: f99567d1-cadf-40c5-b1dc-f86739b2b16c] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:06:39.241008 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-f7526bb4-1918-435e-9516-bf92f704d121 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:39.241470 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-f7526bb4-1918-435e-9516-bf92f704d121 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:39.242268 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-f7526bb4-1918-435e-9516-bf92f704d121 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:39.242717 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-f7526bb4-1918-435e-9516-bf92f704d121 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:39.424191 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-f7526bb4-1918-435e-9516-bf92f704d121 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:06:39.436361 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-f7526bb4-1918-435e-9516-bf92f704d121 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:06:39.438115 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-f7526bb4-1918-435e-9516-bf92f704d121 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:06:39.439868 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-f7526bb4-1918-435e-9516-bf92f704d121 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] 10.222.0.43 "GET /compute/v2.1/servers/f99567d1-cadf-40c5-b1dc-f86739b2b16c" status: 200 len: 1810 microversion: 2.20 time: 0.213981 Jun 29 08:06:39.443556 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 226/438] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 29 08:06:39 2022] GET /compute/v2.1/servers/f99567d1-cadf-40c5-b1dc-f86739b2b16c => generated 1810 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:06:39.654982 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-df0c41ff-5777-4824-8466-dcc7b9b8d713 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:06:39.657910 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-df0c41ff-5777-4824-8466-dcc7b9b8d713 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] [instance: 83a86ef0-c066-44a7-b4eb-e32dce6e0069] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:06:39.666426 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-df0c41ff-5777-4824-8466-dcc7b9b8d713 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:39.666898 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-df0c41ff-5777-4824-8466-dcc7b9b8d713 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:39.668025 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-df0c41ff-5777-4824-8466-dcc7b9b8d713 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:39.668302 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-df0c41ff-5777-4824-8466-dcc7b9b8d713 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:39.918391 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-df0c41ff-5777-4824-8466-dcc7b9b8d713 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de6636a0522642799e43a8f02ee602ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a20f6f9f254aae91c952ee44a4ff74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:06:39.932058 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-df0c41ff-5777-4824-8466-dcc7b9b8d713 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] 10.222.0.43 "GET /compute/v2.1/servers/83a86ef0-c066-44a7-b4eb-e32dce6e0069" status: 200 len: 1260 microversion: 2.1 time: 0.284552 Jun 29 08:06:39.933189 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 227/439] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:06:39 2022] GET /compute/v2.1/servers/83a86ef0-c066-44a7-b4eb-e32dce6e0069 => generated 1260 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:06:40.246914 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-d6648350-a136-44cb-a05d-ea6dd27a70bc tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:06:40.248049 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-d6648350-a136-44cb-a05d-ea6dd27a70bc tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] [instance: c6c089a8-9bde-42b2-aa4e-014dcc9a6a30] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:06:40.258795 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-d6648350-a136-44cb-a05d-ea6dd27a70bc tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:40.259511 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-d6648350-a136-44cb-a05d-ea6dd27a70bc tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:40.260675 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-d6648350-a136-44cb-a05d-ea6dd27a70bc tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:40.261378 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-d6648350-a136-44cb-a05d-ea6dd27a70bc tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:40.346705 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-d6648350-a136-44cb-a05d-ea6dd27a70bc tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1feaba97f594ffda9dd2962bebdc082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdadf97d44048c3bec51c0ae58ee4a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:06:40.358576 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-d6648350-a136-44cb-a05d-ea6dd27a70bc tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] 10.222.0.43 "GET /compute/v2.1/servers/c6c089a8-9bde-42b2-aa4e-014dcc9a6a30" status: 200 len: 1215 microversion: 2.1 time: 0.119137 Jun 29 08:06:40.359336 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 228/440] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:06:40 2022] GET /compute/v2.1/servers/c6c089a8-9bde-42b2-aa4e-014dcc9a6a30 => generated 1215 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:06:40.464636 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-8ee538c5-7a47-48f3-90c3-75d220b5d9cd tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:06:40.465843 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-8ee538c5-7a47-48f3-90c3-75d220b5d9cd tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] [instance: f99567d1-cadf-40c5-b1dc-f86739b2b16c] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:06:40.477096 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-8ee538c5-7a47-48f3-90c3-75d220b5d9cd tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:40.477558 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-8ee538c5-7a47-48f3-90c3-75d220b5d9cd tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:40.478365 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-8ee538c5-7a47-48f3-90c3-75d220b5d9cd tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:40.479415 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-8ee538c5-7a47-48f3-90c3-75d220b5d9cd tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:40.589851 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-17d6717a-47db-4f36-b7bc-b17936a0981b tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] 10.222.0.43 "POST /compute/v2.1/servers/4a523b7d-76fc-4f57-9bfe-c9c2b4b0b8c8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 7.538752 Jun 29 08:06:40.590836 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 213/441] 10.222.0.43 () {60 vars in 1322 bytes} [Wed Jun 29 08:06:33 2022] POST /compute/v2.1/servers/4a523b7d-76fc-4f57-9bfe-c9c2b4b0b8c8/os-volume_attachments => generated 194 bytes in 7540 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:06:40.701557 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-8ee538c5-7a47-48f3-90c3-75d220b5d9cd tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:06:40.715708 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-8ee538c5-7a47-48f3-90c3-75d220b5d9cd tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:06:40.719199 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-8ee538c5-7a47-48f3-90c3-75d220b5d9cd tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:06:40.722472 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-8ee538c5-7a47-48f3-90c3-75d220b5d9cd tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] 10.222.0.43 "GET /compute/v2.1/servers/f99567d1-cadf-40c5-b1dc-f86739b2b16c" status: 200 len: 1810 microversion: 2.20 time: 0.263744 Jun 29 08:06:40.723597 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 229/442] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 29 08:06:40 2022] GET /compute/v2.1/servers/f99567d1-cadf-40c5-b1dc-f86739b2b16c => generated 1810 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 29 08:06:40.970357 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-cebc81b5-6880-44c2-acac-d42bc0fe88a8 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:06:40.970357 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-cebc81b5-6880-44c2-acac-d42bc0fe88a8 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] [instance: 83a86ef0-c066-44a7-b4eb-e32dce6e0069] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:06:40.981131 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-cebc81b5-6880-44c2-acac-d42bc0fe88a8 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:40.981857 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-cebc81b5-6880-44c2-acac-d42bc0fe88a8 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:40.983222 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-cebc81b5-6880-44c2-acac-d42bc0fe88a8 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:40.984286 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-cebc81b5-6880-44c2-acac-d42bc0fe88a8 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:41.024197 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG dbcounter [-] [117890] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:06:41.213168 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-cebc81b5-6880-44c2-acac-d42bc0fe88a8 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de6636a0522642799e43a8f02ee602ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a20f6f9f254aae91c952ee44a4ff74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:06:41.227461 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-cebc81b5-6880-44c2-acac-d42bc0fe88a8 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] 10.222.0.43 "GET /compute/v2.1/servers/83a86ef0-c066-44a7-b4eb-e32dce6e0069" status: 200 len: 1260 microversion: 2.1 time: 0.268841 Jun 29 08:06:41.228630 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 214/443] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:06:40 2022] GET /compute/v2.1/servers/83a86ef0-c066-44a7-b4eb-e32dce6e0069 => generated 1260 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:06:41.387245 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-0db59a50-f935-483b-bf7b-d763ab72f80b tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:06:41.388691 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-0db59a50-f935-483b-bf7b-d763ab72f80b tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] [instance: c6c089a8-9bde-42b2-aa4e-014dcc9a6a30] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:06:41.402966 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-0db59a50-f935-483b-bf7b-d763ab72f80b tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:41.403663 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-0db59a50-f935-483b-bf7b-d763ab72f80b tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:41.405271 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-0db59a50-f935-483b-bf7b-d763ab72f80b tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:41.406103 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-0db59a50-f935-483b-bf7b-d763ab72f80b tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:41.563845 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-0db59a50-f935-483b-bf7b-d763ab72f80b tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1feaba97f594ffda9dd2962bebdc082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdadf97d44048c3bec51c0ae58ee4a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:06:41.578564 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-0db59a50-f935-483b-bf7b-d763ab72f80b tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] 10.222.0.43 "GET /compute/v2.1/servers/c6c089a8-9bde-42b2-aa4e-014dcc9a6a30" status: 200 len: 1215 microversion: 2.1 time: 0.199403 Jun 29 08:06:41.580245 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 230/444] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:06:41 2022] GET /compute/v2.1/servers/c6c089a8-9bde-42b2-aa4e-014dcc9a6a30 => generated 1215 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 08:06:41.770176 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-3501e08f-06bc-48ac-8613-0c28d0470993 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:06:41.780800 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-3501e08f-06bc-48ac-8613-0c28d0470993 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] [instance: f99567d1-cadf-40c5-b1dc-f86739b2b16c] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:06:41.812597 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-3501e08f-06bc-48ac-8613-0c28d0470993 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:41.815390 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-3501e08f-06bc-48ac-8613-0c28d0470993 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:41.817162 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-3501e08f-06bc-48ac-8613-0c28d0470993 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:41.817959 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-3501e08f-06bc-48ac-8613-0c28d0470993 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:42.041420 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-3501e08f-06bc-48ac-8613-0c28d0470993 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:06:42.053546 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-3501e08f-06bc-48ac-8613-0c28d0470993 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:06:42.055513 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-3501e08f-06bc-48ac-8613-0c28d0470993 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:06:42.056938 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-3501e08f-06bc-48ac-8613-0c28d0470993 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] 10.222.0.43 "GET /compute/v2.1/servers/f99567d1-cadf-40c5-b1dc-f86739b2b16c" status: 200 len: 1810 microversion: 2.20 time: 0.314031 Jun 29 08:06:42.057840 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 215/445] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 29 08:06:41 2022] GET /compute/v2.1/servers/f99567d1-cadf-40c5-b1dc-f86739b2b16c => generated 1810 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:06:42.248156 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-67b2be31-446a-48e7-a21a-062f01021cf5 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:06:42.248866 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-67b2be31-446a-48e7-a21a-062f01021cf5 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] [instance: 83a86ef0-c066-44a7-b4eb-e32dce6e0069] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:06:42.258083 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-67b2be31-446a-48e7-a21a-062f01021cf5 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:42.258757 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-67b2be31-446a-48e7-a21a-062f01021cf5 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:42.259738 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-67b2be31-446a-48e7-a21a-062f01021cf5 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:42.260498 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-67b2be31-446a-48e7-a21a-062f01021cf5 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:42.452127 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-67b2be31-446a-48e7-a21a-062f01021cf5 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de6636a0522642799e43a8f02ee602ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a20f6f9f254aae91c952ee44a4ff74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:06:42.461406 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-67b2be31-446a-48e7-a21a-062f01021cf5 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] 10.222.0.43 "GET /compute/v2.1/servers/83a86ef0-c066-44a7-b4eb-e32dce6e0069" status: 200 len: 1260 microversion: 2.1 time: 0.217637 Jun 29 08:06:42.461991 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 231/446] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:06:42 2022] GET /compute/v2.1/servers/83a86ef0-c066-44a7-b4eb-e32dce6e0069 => generated 1260 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 08:06:42.605382 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-bdf0b1b9-c223-4f6a-bc7a-c4f8e8f03114 tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:06:42.607307 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-bdf0b1b9-c223-4f6a-bc7a-c4f8e8f03114 tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] [instance: c6c089a8-9bde-42b2-aa4e-014dcc9a6a30] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:06:42.634465 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-bdf0b1b9-c223-4f6a-bc7a-c4f8e8f03114 tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:42.636722 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-bdf0b1b9-c223-4f6a-bc7a-c4f8e8f03114 tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:42.643591 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-bdf0b1b9-c223-4f6a-bc7a-c4f8e8f03114 tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:42.649967 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-bdf0b1b9-c223-4f6a-bc7a-c4f8e8f03114 tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:42.774441 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-bdf0b1b9-c223-4f6a-bc7a-c4f8e8f03114 tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1feaba97f594ffda9dd2962bebdc082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdadf97d44048c3bec51c0ae58ee4a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:06:42.793970 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-bdf0b1b9-c223-4f6a-bc7a-c4f8e8f03114 tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] 10.222.0.43 "GET /compute/v2.1/servers/c6c089a8-9bde-42b2-aa4e-014dcc9a6a30" status: 200 len: 1277 microversion: 2.1 time: 0.199172 Jun 29 08:06:42.795081 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 216/447] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:06:42 2022] GET /compute/v2.1/servers/c6c089a8-9bde-42b2-aa4e-014dcc9a6a30 => generated 1277 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:06:43.077668 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-ad9fc1ed-51e1-42d0-b3ce-7360fe2a4d9e tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:06:43.078413 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-ad9fc1ed-51e1-42d0-b3ce-7360fe2a4d9e tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] [instance: f99567d1-cadf-40c5-b1dc-f86739b2b16c] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:06:43.086413 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ad9fc1ed-51e1-42d0-b3ce-7360fe2a4d9e tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:43.087139 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ad9fc1ed-51e1-42d0-b3ce-7360fe2a4d9e tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:43.087679 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ad9fc1ed-51e1-42d0-b3ce-7360fe2a4d9e tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:43.088127 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ad9fc1ed-51e1-42d0-b3ce-7360fe2a4d9e tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:43.354640 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-ad9fc1ed-51e1-42d0-b3ce-7360fe2a4d9e tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:06:43.368341 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-ad9fc1ed-51e1-42d0-b3ce-7360fe2a4d9e tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:06:43.370260 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-ad9fc1ed-51e1-42d0-b3ce-7360fe2a4d9e tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:06:43.372218 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-ad9fc1ed-51e1-42d0-b3ce-7360fe2a4d9e tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] 10.222.0.43 "GET /compute/v2.1/servers/f99567d1-cadf-40c5-b1dc-f86739b2b16c" status: 200 len: 1810 microversion: 2.20 time: 0.299769 Jun 29 08:06:43.373308 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 232/448] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 29 08:06:43 2022] GET /compute/v2.1/servers/f99567d1-cadf-40c5-b1dc-f86739b2b16c => generated 1810 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:06:43.493001 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-bf8f7400-05c6-415f-bb66-bf7d2cfd20e7 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:06:43.494452 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-bf8f7400-05c6-415f-bb66-bf7d2cfd20e7 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] [instance: 83a86ef0-c066-44a7-b4eb-e32dce6e0069] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:06:43.511617 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-bf8f7400-05c6-415f-bb66-bf7d2cfd20e7 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:43.512341 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-bf8f7400-05c6-415f-bb66-bf7d2cfd20e7 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:43.513473 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-bf8f7400-05c6-415f-bb66-bf7d2cfd20e7 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:43.514239 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-bf8f7400-05c6-415f-bb66-bf7d2cfd20e7 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:43.747132 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-bf8f7400-05c6-415f-bb66-bf7d2cfd20e7 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de6636a0522642799e43a8f02ee602ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a20f6f9f254aae91c952ee44a4ff74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:06:43.762797 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-9027aac1-256a-4a0b-ba1d-aa0b29b5db14 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:06:43.763752 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-bf8f7400-05c6-415f-bb66-bf7d2cfd20e7 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] 10.222.0.43 "GET /compute/v2.1/servers/83a86ef0-c066-44a7-b4eb-e32dce6e0069" status: 200 len: 1260 microversion: 2.1 time: 0.278126 Jun 29 08:06:43.764451 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 217/449] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:06:43 2022] GET /compute/v2.1/servers/83a86ef0-c066-44a7-b4eb-e32dce6e0069 => generated 1260 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:06:43.769341 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_cell0:SELECT=4 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:06:43.780930 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-9027aac1-256a-4a0b-ba1d-aa0b29b5db14 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:43.782729 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-9027aac1-256a-4a0b-ba1d-aa0b29b5db14 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:43.819745 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-35b237b6-a7c4-4b8f-a585-d6cca911fefd tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:06:43.820569 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-35b237b6-a7c4-4b8f-a585-d6cca911fefd tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] [instance: c6c089a8-9bde-42b2-aa4e-014dcc9a6a30] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:06:43.827068 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-35b237b6-a7c4-4b8f-a585-d6cca911fefd tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:43.827849 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-35b237b6-a7c4-4b8f-a585-d6cca911fefd tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:43.829678 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-35b237b6-a7c4-4b8f-a585-d6cca911fefd tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:43.830429 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-35b237b6-a7c4-4b8f-a585-d6cca911fefd tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:43.834437 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-9027aac1-256a-4a0b-ba1d-aa0b29b5db14 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] [instance: d5d97f9b-3f4a-4a5e-89e8-98d55412fe71] Going to try to stop instance {{(pid=117889) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 29 08:06:43.962297 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-9027aac1-256a-4a0b-ba1d-aa0b29b5db14 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] 10.222.0.43 "POST /compute/v2.1/servers/d5d97f9b-3f4a-4a5e-89e8-98d55412fe71/action" status: 202 len: 0 microversion: 2.1 time: 0.206948 Jun 29 08:06:43.962929 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 233/450] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Jun 29 08:06:43 2022] POST /compute/v2.1/servers/d5d97f9b-3f4a-4a5e-89e8-98d55412fe71/action => generated 0 bytes in 209 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 29 08:06:43.986409 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-75ef672e-d043-4965-9e5a-7877fa7dff25 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:06:43.987285 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-75ef672e-d043-4965-9e5a-7877fa7dff25 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] [instance: d5d97f9b-3f4a-4a5e-89e8-98d55412fe71] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:06:44.003981 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-75ef672e-d043-4965-9e5a-7877fa7dff25 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:44.004444 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-75ef672e-d043-4965-9e5a-7877fa7dff25 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:44.005555 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-75ef672e-d043-4965-9e5a-7877fa7dff25 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:44.006006 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-75ef672e-d043-4965-9e5a-7877fa7dff25 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:44.021328 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-35b237b6-a7c4-4b8f-a585-d6cca911fefd tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1feaba97f594ffda9dd2962bebdc082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdadf97d44048c3bec51c0ae58ee4a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:06:44.039835 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-35b237b6-a7c4-4b8f-a585-d6cca911fefd tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] 10.222.0.43 "GET /compute/v2.1/servers/c6c089a8-9bde-42b2-aa4e-014dcc9a6a30" status: 200 len: 1319 microversion: 2.1 time: 0.224175 Jun 29 08:06:44.040433 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 218/451] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:06:43 2022] GET /compute/v2.1/servers/c6c089a8-9bde-42b2-aa4e-014dcc9a6a30 => generated 1319 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:06:44.281044 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-75ef672e-d043-4965-9e5a-7877fa7dff25 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c70c44993ab240b1a5231df4c9d550c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e0c37d941434569b3dbd07e22125210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:06:44.292188 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-75ef672e-d043-4965-9e5a-7877fa7dff25 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] 10.222.0.43 "GET /compute/v2.1/servers/d5d97f9b-3f4a-4a5e-89e8-98d55412fe71" status: 200 len: 1677 microversion: 2.1 time: 0.317839 Jun 29 08:06:44.293660 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 234/452] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:06:43 2022] GET /compute/v2.1/servers/d5d97f9b-3f4a-4a5e-89e8-98d55412fe71 => generated 1677 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:06:44.399844 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-905916e1-bfdc-44ae-ae79-10d04b3c8989 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:06:44.401390 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-905916e1-bfdc-44ae-ae79-10d04b3c8989 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] [instance: f99567d1-cadf-40c5-b1dc-f86739b2b16c] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:06:44.411778 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-905916e1-bfdc-44ae-ae79-10d04b3c8989 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:44.412901 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-905916e1-bfdc-44ae-ae79-10d04b3c8989 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:44.414478 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-905916e1-bfdc-44ae-ae79-10d04b3c8989 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:44.415023 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-905916e1-bfdc-44ae-ae79-10d04b3c8989 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:44.605775 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-905916e1-bfdc-44ae-ae79-10d04b3c8989 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:06:44.623910 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-905916e1-bfdc-44ae-ae79-10d04b3c8989 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:06:44.627912 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-905916e1-bfdc-44ae-ae79-10d04b3c8989 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:06:44.630783 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-905916e1-bfdc-44ae-ae79-10d04b3c8989 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] 10.222.0.43 "GET /compute/v2.1/servers/f99567d1-cadf-40c5-b1dc-f86739b2b16c" status: 200 len: 1810 microversion: 2.20 time: 0.237417 Jun 29 08:06:44.645269 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 219/453] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 29 08:06:44 2022] GET /compute/v2.1/servers/f99567d1-cadf-40c5-b1dc-f86739b2b16c => generated 1810 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:06:44.706061 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [req-3602cf70-771d-490c-afe5-a861c350a8f8 req-1c61a5d7-f9f3-4310-87b3-8a53de8f5196 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c6c089a8-9bde-42b2-aa4e-014dcc9a6a30", "tag": "fd0c00d6-7d1f-4a23-a222-4f83153cce1e"}]} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:06:44.724665 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_cell0:SELECT=8 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:06:44.733615 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-3602cf70-771d-490c-afe5-a861c350a8f8 req-1c61a5d7-f9f3-4310-87b3-8a53de8f5196 service nova] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:44.734790 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-3602cf70-771d-490c-afe5-a861c350a8f8 req-1c61a5d7-f9f3-4310-87b3-8a53de8f5196 service nova] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:44.762656 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.compute.server_external_events [req-3602cf70-771d-490c-afe5-a861c350a8f8 req-1c61a5d7-f9f3-4310-87b3-8a53de8f5196 service nova] Creating event network-changed:fd0c00d6-7d1f-4a23-a222-4f83153cce1e for instance c6c089a8-9bde-42b2-aa4e-014dcc9a6a30 on hv-cinder-76810 Jun 29 08:06:44.772477 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [req-3602cf70-771d-490c-afe5-a861c350a8f8 req-1c61a5d7-f9f3-4310-87b3-8a53de8f5196 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074981 Jun 29 08:06:44.773931 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 235/454] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jun 29 08:06:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:06:44.797126 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-77ba6123-c6ca-42b5-a49a-54f3be89dc0c tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:06:44.798709 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-77ba6123-c6ca-42b5-a49a-54f3be89dc0c tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] [instance: 83a86ef0-c066-44a7-b4eb-e32dce6e0069] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:06:44.810790 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-77ba6123-c6ca-42b5-a49a-54f3be89dc0c tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:44.811587 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-77ba6123-c6ca-42b5-a49a-54f3be89dc0c tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:44.813627 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-77ba6123-c6ca-42b5-a49a-54f3be89dc0c tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:44.814437 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-77ba6123-c6ca-42b5-a49a-54f3be89dc0c tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:45.009819 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-77ba6123-c6ca-42b5-a49a-54f3be89dc0c tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de6636a0522642799e43a8f02ee602ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a20f6f9f254aae91c952ee44a4ff74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:06:45.018565 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-77ba6123-c6ca-42b5-a49a-54f3be89dc0c tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] 10.222.0.43 "GET /compute/v2.1/servers/83a86ef0-c066-44a7-b4eb-e32dce6e0069" status: 200 len: 1260 microversion: 2.1 time: 0.229381 Jun 29 08:06:45.019279 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 220/455] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:06:44 2022] GET /compute/v2.1/servers/83a86ef0-c066-44a7-b4eb-e32dce6e0069 => generated 1260 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:06:45.073286 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-b69355fa-2f93-4265-acbb-72f2d2b81ab3 tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:06:45.074685 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-b69355fa-2f93-4265-acbb-72f2d2b81ab3 tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] [instance: c6c089a8-9bde-42b2-aa4e-014dcc9a6a30] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:06:45.087565 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-b69355fa-2f93-4265-acbb-72f2d2b81ab3 tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:45.088478 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-b69355fa-2f93-4265-acbb-72f2d2b81ab3 tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:45.090388 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-b69355fa-2f93-4265-acbb-72f2d2b81ab3 tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:45.091208 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-b69355fa-2f93-4265-acbb-72f2d2b81ab3 tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:45.316925 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-3802951f-c7bd-44d1-8e17-c5fbba80ce8e tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:06:45.317925 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-3802951f-c7bd-44d1-8e17-c5fbba80ce8e tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] [instance: d5d97f9b-3f4a-4a5e-89e8-98d55412fe71] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:06:45.324365 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-3802951f-c7bd-44d1-8e17-c5fbba80ce8e tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:45.325127 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-3802951f-c7bd-44d1-8e17-c5fbba80ce8e tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:45.325934 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-3802951f-c7bd-44d1-8e17-c5fbba80ce8e tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:45.326369 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-3802951f-c7bd-44d1-8e17-c5fbba80ce8e tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:45.335579 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-b69355fa-2f93-4265-acbb-72f2d2b81ab3 tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1feaba97f594ffda9dd2962bebdc082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdadf97d44048c3bec51c0ae58ee4a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:06:45.338668 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:06:45.354789 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-b69355fa-2f93-4265-acbb-72f2d2b81ab3 tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] 10.222.0.43 "GET /compute/v2.1/servers/c6c089a8-9bde-42b2-aa4e-014dcc9a6a30" status: 200 len: 1319 microversion: 2.1 time: 0.289753 Jun 29 08:06:45.358238 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 236/456] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:06:45 2022] GET /compute/v2.1/servers/c6c089a8-9bde-42b2-aa4e-014dcc9a6a30 => generated 1319 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 08:06:45.499213 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-3802951f-c7bd-44d1-8e17-c5fbba80ce8e tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c70c44993ab240b1a5231df4c9d550c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e0c37d941434569b3dbd07e22125210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:06:45.508273 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-3802951f-c7bd-44d1-8e17-c5fbba80ce8e tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] 10.222.0.43 "GET /compute/v2.1/servers/d5d97f9b-3f4a-4a5e-89e8-98d55412fe71" status: 200 len: 1677 microversion: 2.1 time: 0.195276 Jun 29 08:06:45.508943 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 221/457] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:06:45 2022] GET /compute/v2.1/servers/d5d97f9b-3f4a-4a5e-89e8-98d55412fe71 => generated 1677 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 08:06:45.661515 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-ee3c8ae6-fa81-477d-ad73-48082e7c36b9 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:06:45.662363 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-ee3c8ae6-fa81-477d-ad73-48082e7c36b9 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] [instance: f99567d1-cadf-40c5-b1dc-f86739b2b16c] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:06:45.671356 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ee3c8ae6-fa81-477d-ad73-48082e7c36b9 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:45.671870 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ee3c8ae6-fa81-477d-ad73-48082e7c36b9 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:45.672909 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ee3c8ae6-fa81-477d-ad73-48082e7c36b9 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:45.673568 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ee3c8ae6-fa81-477d-ad73-48082e7c36b9 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:45.834990 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-ee3c8ae6-fa81-477d-ad73-48082e7c36b9 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:06:45.846536 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-ee3c8ae6-fa81-477d-ad73-48082e7c36b9 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:06:45.848435 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-ee3c8ae6-fa81-477d-ad73-48082e7c36b9 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:06:45.849738 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-ee3c8ae6-fa81-477d-ad73-48082e7c36b9 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] 10.222.0.43 "GET /compute/v2.1/servers/f99567d1-cadf-40c5-b1dc-f86739b2b16c" status: 200 len: 1810 microversion: 2.20 time: 0.193770 Jun 29 08:06:45.850508 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 237/458] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 29 08:06:45 2022] GET /compute/v2.1/servers/f99567d1-cadf-40c5-b1dc-f86739b2b16c => generated 1810 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:06:45.992652 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [req-db9dcc72-ae85-4b3b-836a-79e10c87ba14 req-16815717-0bf5-443c-b389-456ad3371c24 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "83a86ef0-c066-44a7-b4eb-e32dce6e0069", "name": "network-vif-plugged", "status": "completed", "tag": "3828b918-ada6-49b4-b99e-2bfa66c92b2d"}]} {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:06:46.006762 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [req-db9dcc72-ae85-4b3b-836a-79e10c87ba14 req-16815717-0bf5-443c-b389-456ad3371c24 service nova] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:46.008043 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [req-db9dcc72-ae85-4b3b-836a-79e10c87ba14 req-16815717-0bf5-443c-b389-456ad3371c24 service nova] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:46.025103 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.compute.server_external_events [req-db9dcc72-ae85-4b3b-836a-79e10c87ba14 req-16815717-0bf5-443c-b389-456ad3371c24 service nova] Creating event network-vif-plugged:3828b918-ada6-49b4-b99e-2bfa66c92b2d for instance 83a86ef0-c066-44a7-b4eb-e32dce6e0069 on hv-cinder-76810 Jun 29 08:06:46.033894 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [req-db9dcc72-ae85-4b3b-836a-79e10c87ba14 req-16815717-0bf5-443c-b389-456ad3371c24 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045581 Jun 29 08:06:46.034951 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 222/459] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jun 29 08:06:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 29 08:06:46.041378 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-8de24ef4-7bf1-4559-a072-7cc3ff737ac9 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:06:46.042514 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-8de24ef4-7bf1-4559-a072-7cc3ff737ac9 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] [instance: 83a86ef0-c066-44a7-b4eb-e32dce6e0069] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:06:46.054250 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-8de24ef4-7bf1-4559-a072-7cc3ff737ac9 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:46.054976 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-8de24ef4-7bf1-4559-a072-7cc3ff737ac9 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:46.056305 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-8de24ef4-7bf1-4559-a072-7cc3ff737ac9 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:46.057024 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-8de24ef4-7bf1-4559-a072-7cc3ff737ac9 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:46.248787 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-8de24ef4-7bf1-4559-a072-7cc3ff737ac9 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de6636a0522642799e43a8f02ee602ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a20f6f9f254aae91c952ee44a4ff74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:06:46.257629 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-8de24ef4-7bf1-4559-a072-7cc3ff737ac9 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] 10.222.0.43 "GET /compute/v2.1/servers/83a86ef0-c066-44a7-b4eb-e32dce6e0069" status: 200 len: 1260 microversion: 2.1 time: 0.223968 Jun 29 08:06:46.258408 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 238/460] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:06:46 2022] GET /compute/v2.1/servers/83a86ef0-c066-44a7-b4eb-e32dce6e0069 => generated 1260 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 08:06:46.374137 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-89d1df88-13eb-4929-8870-71b1b7e741d9 tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:06:46.374899 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-89d1df88-13eb-4929-8870-71b1b7e741d9 tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] [instance: c6c089a8-9bde-42b2-aa4e-014dcc9a6a30] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:06:46.381988 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-89d1df88-13eb-4929-8870-71b1b7e741d9 tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:46.382744 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-89d1df88-13eb-4929-8870-71b1b7e741d9 tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:46.383831 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-89d1df88-13eb-4929-8870-71b1b7e741d9 tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:46.384331 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-89d1df88-13eb-4929-8870-71b1b7e741d9 tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:46.530254 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-3c697ea9-ebe3-406d-bb8c-6443d65e1416 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:06:46.531372 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-3c697ea9-ebe3-406d-bb8c-6443d65e1416 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] [instance: d5d97f9b-3f4a-4a5e-89e8-98d55412fe71] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:06:46.543947 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-3c697ea9-ebe3-406d-bb8c-6443d65e1416 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:46.544757 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-3c697ea9-ebe3-406d-bb8c-6443d65e1416 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:46.546237 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-3c697ea9-ebe3-406d-bb8c-6443d65e1416 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:46.546999 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-3c697ea9-ebe3-406d-bb8c-6443d65e1416 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:46.561716 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-89d1df88-13eb-4929-8870-71b1b7e741d9 tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1feaba97f594ffda9dd2962bebdc082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdadf97d44048c3bec51c0ae58ee4a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:06:46.570779 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-89d1df88-13eb-4929-8870-71b1b7e741d9 tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] 10.222.0.43 "GET /compute/v2.1/servers/c6c089a8-9bde-42b2-aa4e-014dcc9a6a30" status: 200 len: 1319 microversion: 2.1 time: 0.201044 Jun 29 08:06:46.571366 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 223/461] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:06:46 2022] GET /compute/v2.1/servers/c6c089a8-9bde-42b2-aa4e-014dcc9a6a30 => generated 1319 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:06:46.874012 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-058fd7b0-80d8-40ff-b796-1794269759d5 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:06:46.876080 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-058fd7b0-80d8-40ff-b796-1794269759d5 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] [instance: f99567d1-cadf-40c5-b1dc-f86739b2b16c] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:06:46.887929 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-058fd7b0-80d8-40ff-b796-1794269759d5 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:46.888643 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-058fd7b0-80d8-40ff-b796-1794269759d5 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:46.889952 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-058fd7b0-80d8-40ff-b796-1794269759d5 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:46.890666 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-058fd7b0-80d8-40ff-b796-1794269759d5 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:47.069212 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-058fd7b0-80d8-40ff-b796-1794269759d5 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:06:47.079823 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-058fd7b0-80d8-40ff-b796-1794269759d5 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:06:47.081443 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-058fd7b0-80d8-40ff-b796-1794269759d5 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:06:47.082675 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-058fd7b0-80d8-40ff-b796-1794269759d5 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] 10.222.0.43 "GET /compute/v2.1/servers/f99567d1-cadf-40c5-b1dc-f86739b2b16c" status: 200 len: 1810 microversion: 2.20 time: 0.217364 Jun 29 08:06:47.083256 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 224/462] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 29 08:06:46 2022] GET /compute/v2.1/servers/f99567d1-cadf-40c5-b1dc-f86739b2b16c => generated 1810 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 29 08:06:47.113565 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-3c697ea9-ebe3-406d-bb8c-6443d65e1416 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c70c44993ab240b1a5231df4c9d550c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e0c37d941434569b3dbd07e22125210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:06:47.122189 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-3c697ea9-ebe3-406d-bb8c-6443d65e1416 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] 10.222.0.43 "GET /compute/v2.1/servers/d5d97f9b-3f4a-4a5e-89e8-98d55412fe71" status: 200 len: 1677 microversion: 2.1 time: 0.598956 Jun 29 08:06:47.124001 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 239/463] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:06:46 2022] GET /compute/v2.1/servers/d5d97f9b-3f4a-4a5e-89e8-98d55412fe71 => generated 1677 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 08:06:47.276297 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-bfd0276c-c130-477c-92d9-0e104138eb17 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:06:47.276911 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-bfd0276c-c130-477c-92d9-0e104138eb17 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] [instance: 83a86ef0-c066-44a7-b4eb-e32dce6e0069] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:06:47.284223 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-bfd0276c-c130-477c-92d9-0e104138eb17 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:47.284737 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-bfd0276c-c130-477c-92d9-0e104138eb17 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:47.285626 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-bfd0276c-c130-477c-92d9-0e104138eb17 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:47.286239 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-bfd0276c-c130-477c-92d9-0e104138eb17 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:47.445203 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-bfd0276c-c130-477c-92d9-0e104138eb17 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de6636a0522642799e43a8f02ee602ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a20f6f9f254aae91c952ee44a4ff74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:06:47.455138 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-bfd0276c-c130-477c-92d9-0e104138eb17 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] 10.222.0.43 "GET /compute/v2.1/servers/83a86ef0-c066-44a7-b4eb-e32dce6e0069" status: 200 len: 1260 microversion: 2.1 time: 0.181761 Jun 29 08:06:47.455892 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 225/464] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:06:47 2022] GET /compute/v2.1/servers/83a86ef0-c066-44a7-b4eb-e32dce6e0069 => generated 1260 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:06:47.596327 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-9809cc19-a1a4-4458-9455-0811af002558 tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:06:47.597191 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-9809cc19-a1a4-4458-9455-0811af002558 tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] [instance: c6c089a8-9bde-42b2-aa4e-014dcc9a6a30] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:06:47.604097 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-9809cc19-a1a4-4458-9455-0811af002558 tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:47.604692 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-9809cc19-a1a4-4458-9455-0811af002558 tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:47.605634 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-9809cc19-a1a4-4458-9455-0811af002558 tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:47.606161 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-9809cc19-a1a4-4458-9455-0811af002558 tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:47.754538 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-9809cc19-a1a4-4458-9455-0811af002558 tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1feaba97f594ffda9dd2962bebdc082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdadf97d44048c3bec51c0ae58ee4a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:06:47.767342 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-9809cc19-a1a4-4458-9455-0811af002558 tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] 10.222.0.43 "GET /compute/v2.1/servers/c6c089a8-9bde-42b2-aa4e-014dcc9a6a30" status: 200 len: 1319 microversion: 2.1 time: 0.175243 Jun 29 08:06:47.768222 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 240/465] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:06:47 2022] GET /compute/v2.1/servers/c6c089a8-9bde-42b2-aa4e-014dcc9a6a30 => generated 1319 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:06:48.102575 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-c10c2a4d-f99a-4d54-9597-235f6e20d1db tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:06:48.103414 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-c10c2a4d-f99a-4d54-9597-235f6e20d1db tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] [instance: f99567d1-cadf-40c5-b1dc-f86739b2b16c] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:06:48.117647 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-c10c2a4d-f99a-4d54-9597-235f6e20d1db tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:48.118319 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-c10c2a4d-f99a-4d54-9597-235f6e20d1db tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:48.119559 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-c10c2a4d-f99a-4d54-9597-235f6e20d1db tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:48.120130 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-c10c2a4d-f99a-4d54-9597-235f6e20d1db tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:48.141854 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-045418a6-9373-432c-bfef-037bb90a18f4 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:06:48.142878 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-045418a6-9373-432c-bfef-037bb90a18f4 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] [instance: d5d97f9b-3f4a-4a5e-89e8-98d55412fe71] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:06:48.156094 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-045418a6-9373-432c-bfef-037bb90a18f4 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:48.158167 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-045418a6-9373-432c-bfef-037bb90a18f4 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:48.159766 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-045418a6-9373-432c-bfef-037bb90a18f4 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:48.160558 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-045418a6-9373-432c-bfef-037bb90a18f4 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:48.322507 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-c10c2a4d-f99a-4d54-9597-235f6e20d1db tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:06:48.336536 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-c10c2a4d-f99a-4d54-9597-235f6e20d1db tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:06:48.338688 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-c10c2a4d-f99a-4d54-9597-235f6e20d1db tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:06:48.340095 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-c10c2a4d-f99a-4d54-9597-235f6e20d1db tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] 10.222.0.43 "GET /compute/v2.1/servers/f99567d1-cadf-40c5-b1dc-f86739b2b16c" status: 200 len: 1810 microversion: 2.20 time: 0.241593 Jun 29 08:06:48.341166 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 226/466] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 29 08:06:48 2022] GET /compute/v2.1/servers/f99567d1-cadf-40c5-b1dc-f86739b2b16c => generated 1810 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:06:48.372241 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-045418a6-9373-432c-bfef-037bb90a18f4 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c70c44993ab240b1a5231df4c9d550c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e0c37d941434569b3dbd07e22125210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:06:48.381380 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-045418a6-9373-432c-bfef-037bb90a18f4 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] 10.222.0.43 "GET /compute/v2.1/servers/d5d97f9b-3f4a-4a5e-89e8-98d55412fe71" status: 200 len: 1677 microversion: 2.1 time: 0.244498 Jun 29 08:06:48.381976 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 241/467] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:06:48 2022] GET /compute/v2.1/servers/d5d97f9b-3f4a-4a5e-89e8-98d55412fe71 => generated 1677 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 08:06:48.474631 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-9f4ecda6-40fa-4cb7-a2d3-adadfe71f6e9 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:06:48.476218 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-9f4ecda6-40fa-4cb7-a2d3-adadfe71f6e9 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] [instance: 83a86ef0-c066-44a7-b4eb-e32dce6e0069] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:06:48.482490 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-9f4ecda6-40fa-4cb7-a2d3-adadfe71f6e9 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:48.482938 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-9f4ecda6-40fa-4cb7-a2d3-adadfe71f6e9 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:48.483734 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-9f4ecda6-40fa-4cb7-a2d3-adadfe71f6e9 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:48.484170 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-9f4ecda6-40fa-4cb7-a2d3-adadfe71f6e9 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:48.640547 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-9f4ecda6-40fa-4cb7-a2d3-adadfe71f6e9 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de6636a0522642799e43a8f02ee602ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a20f6f9f254aae91c952ee44a4ff74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:06:48.649673 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-9f4ecda6-40fa-4cb7-a2d3-adadfe71f6e9 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] 10.222.0.43 "GET /compute/v2.1/servers/83a86ef0-c066-44a7-b4eb-e32dce6e0069" status: 200 len: 1260 microversion: 2.1 time: 0.179518 Jun 29 08:06:48.650278 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 227/468] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:06:48 2022] GET /compute/v2.1/servers/83a86ef0-c066-44a7-b4eb-e32dce6e0069 => generated 1260 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:06:48.789369 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-ee8214e5-ed5b-4cde-9879-6acb58c70e4a tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:06:48.789897 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-ee8214e5-ed5b-4cde-9879-6acb58c70e4a tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] [instance: c6c089a8-9bde-42b2-aa4e-014dcc9a6a30] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:06:48.796416 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ee8214e5-ed5b-4cde-9879-6acb58c70e4a tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:48.796869 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ee8214e5-ed5b-4cde-9879-6acb58c70e4a tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:48.798735 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ee8214e5-ed5b-4cde-9879-6acb58c70e4a tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:48.799192 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ee8214e5-ed5b-4cde-9879-6acb58c70e4a tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:48.949566 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-ee8214e5-ed5b-4cde-9879-6acb58c70e4a tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1feaba97f594ffda9dd2962bebdc082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdadf97d44048c3bec51c0ae58ee4a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:06:48.960293 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-ee8214e5-ed5b-4cde-9879-6acb58c70e4a tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] 10.222.0.43 "GET /compute/v2.1/servers/c6c089a8-9bde-42b2-aa4e-014dcc9a6a30" status: 200 len: 1319 microversion: 2.1 time: 0.174747 Jun 29 08:06:48.961180 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 242/469] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:06:48 2022] GET /compute/v2.1/servers/c6c089a8-9bde-42b2-aa4e-014dcc9a6a30 => generated 1319 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:06:49.360308 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-c2a2b396-c11f-4474-895e-194691bf8529 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:06:49.361055 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-c2a2b396-c11f-4474-895e-194691bf8529 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] [instance: f99567d1-cadf-40c5-b1dc-f86739b2b16c] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:06:49.370374 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-c2a2b396-c11f-4474-895e-194691bf8529 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:49.370870 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-c2a2b396-c11f-4474-895e-194691bf8529 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:49.371674 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-c2a2b396-c11f-4474-895e-194691bf8529 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:49.372114 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-c2a2b396-c11f-4474-895e-194691bf8529 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:49.399862 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-c4088407-3479-401f-889f-912562f7d6b2 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:06:49.400485 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-c4088407-3479-401f-889f-912562f7d6b2 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] [instance: d5d97f9b-3f4a-4a5e-89e8-98d55412fe71] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:06:49.414418 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c4088407-3479-401f-889f-912562f7d6b2 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:49.414866 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c4088407-3479-401f-889f-912562f7d6b2 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:49.415639 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c4088407-3479-401f-889f-912562f7d6b2 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:49.416073 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c4088407-3479-401f-889f-912562f7d6b2 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:49.550322 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-c2a2b396-c11f-4474-895e-194691bf8529 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:06:49.562562 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-c2a2b396-c11f-4474-895e-194691bf8529 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:06:49.564748 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-c2a2b396-c11f-4474-895e-194691bf8529 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:06:49.566004 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-c2a2b396-c11f-4474-895e-194691bf8529 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] 10.222.0.43 "GET /compute/v2.1/servers/f99567d1-cadf-40c5-b1dc-f86739b2b16c" status: 200 len: 1810 microversion: 2.20 time: 0.209945 Jun 29 08:06:49.566577 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 228/470] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 29 08:06:49 2022] GET /compute/v2.1/servers/f99567d1-cadf-40c5-b1dc-f86739b2b16c => generated 1810 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:06:49.581828 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-c4088407-3479-401f-889f-912562f7d6b2 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c70c44993ab240b1a5231df4c9d550c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e0c37d941434569b3dbd07e22125210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:06:49.589731 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-c4088407-3479-401f-889f-912562f7d6b2 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] 10.222.0.43 "GET /compute/v2.1/servers/d5d97f9b-3f4a-4a5e-89e8-98d55412fe71" status: 200 len: 1677 microversion: 2.1 time: 0.193712 Jun 29 08:06:49.590233 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 243/471] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:06:49 2022] GET /compute/v2.1/servers/d5d97f9b-3f4a-4a5e-89e8-98d55412fe71 => generated 1677 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 08:06:49.667951 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-8400e051-9b54-42d1-813e-a9bf2e62705a tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:06:49.668800 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-8400e051-9b54-42d1-813e-a9bf2e62705a tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] [instance: 83a86ef0-c066-44a7-b4eb-e32dce6e0069] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:06:49.675661 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-8400e051-9b54-42d1-813e-a9bf2e62705a tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:49.676110 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-8400e051-9b54-42d1-813e-a9bf2e62705a tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:49.676890 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-8400e051-9b54-42d1-813e-a9bf2e62705a tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:49.677342 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-8400e051-9b54-42d1-813e-a9bf2e62705a tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:49.850808 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-8400e051-9b54-42d1-813e-a9bf2e62705a tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de6636a0522642799e43a8f02ee602ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a20f6f9f254aae91c952ee44a4ff74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:06:49.876442 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-8400e051-9b54-42d1-813e-a9bf2e62705a tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] 10.222.0.43 "GET /compute/v2.1/servers/83a86ef0-c066-44a7-b4eb-e32dce6e0069" status: 200 len: 1260 microversion: 2.1 time: 0.212387 Jun 29 08:06:49.877396 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 229/472] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:06:49 2022] GET /compute/v2.1/servers/83a86ef0-c066-44a7-b4eb-e32dce6e0069 => generated 1260 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:06:49.979852 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-cffa8131-3aba-46b9-8f79-530c40566e36 tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:06:49.980673 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-cffa8131-3aba-46b9-8f79-530c40566e36 tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] [instance: c6c089a8-9bde-42b2-aa4e-014dcc9a6a30] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:06:49.988132 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-cffa8131-3aba-46b9-8f79-530c40566e36 tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:49.988675 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-cffa8131-3aba-46b9-8f79-530c40566e36 tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:49.989576 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-cffa8131-3aba-46b9-8f79-530c40566e36 tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:49.990176 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-cffa8131-3aba-46b9-8f79-530c40566e36 tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:50.145678 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-cffa8131-3aba-46b9-8f79-530c40566e36 tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1feaba97f594ffda9dd2962bebdc082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdadf97d44048c3bec51c0ae58ee4a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:06:50.160721 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-cffa8131-3aba-46b9-8f79-530c40566e36 tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] 10.222.0.43 "GET /compute/v2.1/servers/c6c089a8-9bde-42b2-aa4e-014dcc9a6a30" status: 200 len: 1319 microversion: 2.1 time: 0.184643 Jun 29 08:06:50.161933 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 244/473] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:06:49 2022] GET /compute/v2.1/servers/c6c089a8-9bde-42b2-aa4e-014dcc9a6a30 => generated 1319 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 08:06:50.180050 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [req-807b35c5-7c59-41cf-aac6-f2d98f66e57e req-42c043be-0809-4c72-bd21-077e51fd019a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c6c089a8-9bde-42b2-aa4e-014dcc9a6a30", "name": "network-vif-plugged", "status": "completed", "tag": "fd0c00d6-7d1f-4a23-a222-4f83153cce1e"}]} {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:06:50.190145 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [req-807b35c5-7c59-41cf-aac6-f2d98f66e57e req-42c043be-0809-4c72-bd21-077e51fd019a service nova] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:50.190639 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [req-807b35c5-7c59-41cf-aac6-f2d98f66e57e req-42c043be-0809-4c72-bd21-077e51fd019a service nova] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:50.205675 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.compute.server_external_events [req-807b35c5-7c59-41cf-aac6-f2d98f66e57e req-42c043be-0809-4c72-bd21-077e51fd019a service nova] Creating event network-vif-plugged:fd0c00d6-7d1f-4a23-a222-4f83153cce1e for instance c6c089a8-9bde-42b2-aa4e-014dcc9a6a30 on hv-cinder-76810 Jun 29 08:06:50.212268 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [req-807b35c5-7c59-41cf-aac6-f2d98f66e57e req-42c043be-0809-4c72-bd21-077e51fd019a service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036175 Jun 29 08:06:50.213504 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 230/474] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jun 29 08:06:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:06:50.586384 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-099e8052-294c-4bd9-9ebc-9d0eae34cfce tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:06:50.586981 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-099e8052-294c-4bd9-9ebc-9d0eae34cfce tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] [instance: f99567d1-cadf-40c5-b1dc-f86739b2b16c] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:06:50.594410 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-099e8052-294c-4bd9-9ebc-9d0eae34cfce tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:50.595038 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-099e8052-294c-4bd9-9ebc-9d0eae34cfce tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:50.595883 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-099e8052-294c-4bd9-9ebc-9d0eae34cfce tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:50.596464 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-099e8052-294c-4bd9-9ebc-9d0eae34cfce tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:50.609462 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-5cb8b691-aa0d-4979-a78c-fd8e18fa8951 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:06:50.611299 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-5cb8b691-aa0d-4979-a78c-fd8e18fa8951 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] [instance: d5d97f9b-3f4a-4a5e-89e8-98d55412fe71] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:06:50.620069 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-5cb8b691-aa0d-4979-a78c-fd8e18fa8951 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:50.620616 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-5cb8b691-aa0d-4979-a78c-fd8e18fa8951 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:50.621659 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-5cb8b691-aa0d-4979-a78c-fd8e18fa8951 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:50.622277 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-5cb8b691-aa0d-4979-a78c-fd8e18fa8951 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:50.766999 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-099e8052-294c-4bd9-9ebc-9d0eae34cfce tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:06:50.782964 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-099e8052-294c-4bd9-9ebc-9d0eae34cfce tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:06:50.786428 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-099e8052-294c-4bd9-9ebc-9d0eae34cfce tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:06:50.788687 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-099e8052-294c-4bd9-9ebc-9d0eae34cfce tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] 10.222.0.43 "GET /compute/v2.1/servers/f99567d1-cadf-40c5-b1dc-f86739b2b16c" status: 200 len: 1810 microversion: 2.20 time: 0.206333 Jun 29 08:06:50.801923 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 245/475] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 29 08:06:50 2022] GET /compute/v2.1/servers/f99567d1-cadf-40c5-b1dc-f86739b2b16c => generated 1810 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:06:50.839580 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-5cb8b691-aa0d-4979-a78c-fd8e18fa8951 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c70c44993ab240b1a5231df4c9d550c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e0c37d941434569b3dbd07e22125210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:06:50.855538 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-5cb8b691-aa0d-4979-a78c-fd8e18fa8951 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] 10.222.0.43 "GET /compute/v2.1/servers/d5d97f9b-3f4a-4a5e-89e8-98d55412fe71" status: 200 len: 1677 microversion: 2.1 time: 0.250877 Jun 29 08:06:50.869439 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 231/476] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:06:50 2022] GET /compute/v2.1/servers/d5d97f9b-3f4a-4a5e-89e8-98d55412fe71 => generated 1677 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 08:06:50.908857 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-b612e623-1d26-4c6a-9fb6-6b50760a4467 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:06:50.913943 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-b612e623-1d26-4c6a-9fb6-6b50760a4467 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] [instance: 83a86ef0-c066-44a7-b4eb-e32dce6e0069] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:06:50.931830 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-b612e623-1d26-4c6a-9fb6-6b50760a4467 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:50.933063 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-b612e623-1d26-4c6a-9fb6-6b50760a4467 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:50.936068 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-b612e623-1d26-4c6a-9fb6-6b50760a4467 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:50.937258 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-b612e623-1d26-4c6a-9fb6-6b50760a4467 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:51.165822 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-b612e623-1d26-4c6a-9fb6-6b50760a4467 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de6636a0522642799e43a8f02ee602ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a20f6f9f254aae91c952ee44a4ff74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:06:51.174770 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-b612e623-1d26-4c6a-9fb6-6b50760a4467 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] 10.222.0.43 "GET /compute/v2.1/servers/83a86ef0-c066-44a7-b4eb-e32dce6e0069" status: 200 len: 1445 microversion: 2.1 time: 0.280825 Jun 29 08:06:51.175369 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 246/477] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:06:50 2022] GET /compute/v2.1/servers/83a86ef0-c066-44a7-b4eb-e32dce6e0069 => generated 1445 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:06:51.187986 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-86acc8db-70a3-4a6b-9351-1d43b614adf0 tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:06:51.189432 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-86acc8db-70a3-4a6b-9351-1d43b614adf0 tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] [instance: c6c089a8-9bde-42b2-aa4e-014dcc9a6a30] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:06:51.197548 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-54b8f524-9c0a-4e27-b527-11eda7b54983 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:06:51.198559 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-54b8f524-9c0a-4e27-b527-11eda7b54983 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] [instance: 83a86ef0-c066-44a7-b4eb-e32dce6e0069] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:06:51.199756 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-86acc8db-70a3-4a6b-9351-1d43b614adf0 tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:51.200472 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-86acc8db-70a3-4a6b-9351-1d43b614adf0 tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:51.201821 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-86acc8db-70a3-4a6b-9351-1d43b614adf0 tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:51.202548 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-86acc8db-70a3-4a6b-9351-1d43b614adf0 tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:51.209569 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-54b8f524-9c0a-4e27-b527-11eda7b54983 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:51.210318 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-54b8f524-9c0a-4e27-b527-11eda7b54983 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:51.210612 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG dbcounter [-] [117890] Writing DB stats nova_cell1:SELECT=100 {{(pid=117890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:06:51.211720 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-54b8f524-9c0a-4e27-b527-11eda7b54983 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:51.212487 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-54b8f524-9c0a-4e27-b527-11eda7b54983 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:51.474187 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-86acc8db-70a3-4a6b-9351-1d43b614adf0 tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1feaba97f594ffda9dd2962bebdc082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdadf97d44048c3bec51c0ae58ee4a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:06:51.480444 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-54b8f524-9c0a-4e27-b527-11eda7b54983 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de6636a0522642799e43a8f02ee602ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a20f6f9f254aae91c952ee44a4ff74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:06:51.495751 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-86acc8db-70a3-4a6b-9351-1d43b614adf0 tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] 10.222.0.43 "GET /compute/v2.1/servers/c6c089a8-9bde-42b2-aa4e-014dcc9a6a30" status: 200 len: 1319 microversion: 2.1 time: 0.311877 Jun 29 08:06:51.496641 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 232/478] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:06:51 2022] GET /compute/v2.1/servers/c6c089a8-9bde-42b2-aa4e-014dcc9a6a30 => generated 1319 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 08:06:51.498897 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-54b8f524-9c0a-4e27-b527-11eda7b54983 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] 10.222.0.43 "GET /compute/v2.1/servers/83a86ef0-c066-44a7-b4eb-e32dce6e0069" status: 200 len: 1445 microversion: 2.1 time: 0.308353 Jun 29 08:06:51.499753 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 247/479] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:06:51 2022] GET /compute/v2.1/servers/83a86ef0-c066-44a7-b4eb-e32dce6e0069 => generated 1445 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 08:06:51.804329 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-f52aeb8a-e84e-485c-b044-d6de8df5d340 tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:06:51.804961 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-f52aeb8a-e84e-485c-b044-d6de8df5d340 tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] [instance: 4a523b7d-76fc-4f57-9bfe-c9c2b4b0b8c8] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:06:51.818967 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-f52aeb8a-e84e-485c-b044-d6de8df5d340 tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:51.819422 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-f52aeb8a-e84e-485c-b044-d6de8df5d340 tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:51.820233 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-f52aeb8a-e84e-485c-b044-d6de8df5d340 tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:51.820678 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-f52aeb8a-e84e-485c-b044-d6de8df5d340 tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:51.827305 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-203b27a4-37c5-4a25-b7e6-eb4c364dc5fa tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:06:51.829622 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-203b27a4-37c5-4a25-b7e6-eb4c364dc5fa tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] [instance: f99567d1-cadf-40c5-b1dc-f86739b2b16c] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:06:51.842826 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-203b27a4-37c5-4a25-b7e6-eb4c364dc5fa tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:51.843604 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-203b27a4-37c5-4a25-b7e6-eb4c364dc5fa tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:51.845783 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-203b27a4-37c5-4a25-b7e6-eb4c364dc5fa tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:51.846585 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-203b27a4-37c5-4a25-b7e6-eb4c364dc5fa tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:52.013044 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-f52aeb8a-e84e-485c-b044-d6de8df5d340 tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6663857e60ca4440a9a620007be4c2c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7afb1bdb06042f4b983631745f32e19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:06:52.031141 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-f52aeb8a-e84e-485c-b044-d6de8df5d340 tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] 10.222.0.43 "GET /compute/v2.1/servers/4a523b7d-76fc-4f57-9bfe-c9c2b4b0b8c8" status: 200 len: 1592 microversion: 2.1 time: 0.230829 Jun 29 08:06:52.033201 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 233/480] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:06:51 2022] GET /compute/v2.1/servers/4a523b7d-76fc-4f57-9bfe-c9c2b4b0b8c8 => generated 1592 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:06:52.048624 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-e1f24205-c91e-4cf4-b8e3-66f8a7869aa6 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:06:52.049314 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-e1f24205-c91e-4cf4-b8e3-66f8a7869aa6 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] [instance: d5d97f9b-3f4a-4a5e-89e8-98d55412fe71] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:06:52.066509 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-e1f24205-c91e-4cf4-b8e3-66f8a7869aa6 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:52.066897 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-e1f24205-c91e-4cf4-b8e3-66f8a7869aa6 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:52.067724 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-e1f24205-c91e-4cf4-b8e3-66f8a7869aa6 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:52.068488 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-e1f24205-c91e-4cf4-b8e3-66f8a7869aa6 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:52.115748 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-203b27a4-37c5-4a25-b7e6-eb4c364dc5fa tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:06:52.130850 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-203b27a4-37c5-4a25-b7e6-eb4c364dc5fa tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:06:52.132508 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-203b27a4-37c5-4a25-b7e6-eb4c364dc5fa tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:06:52.133834 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-203b27a4-37c5-4a25-b7e6-eb4c364dc5fa tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] 10.222.0.43 "GET /compute/v2.1/servers/f99567d1-cadf-40c5-b1dc-f86739b2b16c" status: 200 len: 1810 microversion: 2.20 time: 0.317405 Jun 29 08:06:52.153140 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 248/481] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 29 08:06:51 2022] GET /compute/v2.1/servers/f99567d1-cadf-40c5-b1dc-f86739b2b16c => generated 1810 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:06:52.309079 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-e1f24205-c91e-4cf4-b8e3-66f8a7869aa6 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c70c44993ab240b1a5231df4c9d550c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e0c37d941434569b3dbd07e22125210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:06:52.321837 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-e1f24205-c91e-4cf4-b8e3-66f8a7869aa6 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] 10.222.0.43 "GET /compute/v2.1/servers/d5d97f9b-3f4a-4a5e-89e8-98d55412fe71" status: 200 len: 1677 microversion: 2.1 time: 0.276675 Jun 29 08:06:52.332526 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 234/482] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:06:52 2022] GET /compute/v2.1/servers/d5d97f9b-3f4a-4a5e-89e8-98d55412fe71 => generated 1677 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:06:52.379326 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [req-a9c1364f-c7e4-4e8e-97e3-1a35c734e060 req-29589deb-5f00-4a51-b1cc-d7303211e160 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f99567d1-cadf-40c5-b1dc-f86739b2b16c", "name": "network-vif-plugged", "status": "completed", "tag": "dfb8e71b-41e2-4d03-8de7-4f7323f5b53b"}]} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:06:52.388433 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-a9c1364f-c7e4-4e8e-97e3-1a35c734e060 req-29589deb-5f00-4a51-b1cc-d7303211e160 service nova] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:52.388884 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-a9c1364f-c7e4-4e8e-97e3-1a35c734e060 req-29589deb-5f00-4a51-b1cc-d7303211e160 service nova] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:52.401857 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.compute.server_external_events [req-a9c1364f-c7e4-4e8e-97e3-1a35c734e060 req-29589deb-5f00-4a51-b1cc-d7303211e160 service nova] Creating event network-vif-plugged:dfb8e71b-41e2-4d03-8de7-4f7323f5b53b for instance f99567d1-cadf-40c5-b1dc-f86739b2b16c on hv-cinder-76810 Jun 29 08:06:52.409606 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [req-a9c1364f-c7e4-4e8e-97e3-1a35c734e060 req-29589deb-5f00-4a51-b1cc-d7303211e160 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033982 Jun 29 08:06:52.410987 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 249/483] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jun 29 08:06:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 29 08:06:52.517514 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-51a8b10d-783b-4f6b-abe2-2f0be3ff3687 tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:06:52.518148 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-51a8b10d-783b-4f6b-abe2-2f0be3ff3687 tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] [instance: c6c089a8-9bde-42b2-aa4e-014dcc9a6a30] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:06:52.524808 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-51a8b10d-783b-4f6b-abe2-2f0be3ff3687 tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:52.525549 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-51a8b10d-783b-4f6b-abe2-2f0be3ff3687 tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:52.526344 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-51a8b10d-783b-4f6b-abe2-2f0be3ff3687 tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:52.526781 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-51a8b10d-783b-4f6b-abe2-2f0be3ff3687 tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:52.815800 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-51a8b10d-783b-4f6b-abe2-2f0be3ff3687 tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1feaba97f594ffda9dd2962bebdc082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdadf97d44048c3bec51c0ae58ee4a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:06:52.831097 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-51a8b10d-783b-4f6b-abe2-2f0be3ff3687 tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] 10.222.0.43 "GET /compute/v2.1/servers/c6c089a8-9bde-42b2-aa4e-014dcc9a6a30" status: 200 len: 1319 microversion: 2.1 time: 0.317325 Jun 29 08:06:52.832235 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 235/484] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:06:52 2022] GET /compute/v2.1/servers/c6c089a8-9bde-42b2-aa4e-014dcc9a6a30 => generated 1319 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:06:53.174397 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-fc37d986-a184-4e3c-937d-4f89f2654814 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:06:53.175145 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-fc37d986-a184-4e3c-937d-4f89f2654814 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] [instance: f99567d1-cadf-40c5-b1dc-f86739b2b16c] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:06:53.183608 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-fc37d986-a184-4e3c-937d-4f89f2654814 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:53.184060 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-fc37d986-a184-4e3c-937d-4f89f2654814 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:53.185093 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-fc37d986-a184-4e3c-937d-4f89f2654814 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:53.186301 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-fc37d986-a184-4e3c-937d-4f89f2654814 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:53.340930 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-4d7bf34e-0b3c-438c-8e67-ce171eddde3a tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:06:53.342002 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-4d7bf34e-0b3c-438c-8e67-ce171eddde3a tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] [instance: d5d97f9b-3f4a-4a5e-89e8-98d55412fe71] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:06:53.344592 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG dbcounter [-] [117890] Writing DB stats nova_api:SELECT=70 {{(pid=117890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:06:53.357567 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-4d7bf34e-0b3c-438c-8e67-ce171eddde3a tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:53.364001 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-4d7bf34e-0b3c-438c-8e67-ce171eddde3a tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:53.365378 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-4d7bf34e-0b3c-438c-8e67-ce171eddde3a tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:53.366021 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-4d7bf34e-0b3c-438c-8e67-ce171eddde3a tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:53.446453 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-fc37d986-a184-4e3c-937d-4f89f2654814 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:06:53.456868 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-fc37d986-a184-4e3c-937d-4f89f2654814 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:06:53.458672 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-fc37d986-a184-4e3c-937d-4f89f2654814 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:06:53.460279 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-fc37d986-a184-4e3c-937d-4f89f2654814 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] 10.222.0.43 "GET /compute/v2.1/servers/f99567d1-cadf-40c5-b1dc-f86739b2b16c" status: 200 len: 1810 microversion: 2.20 time: 0.294168 Jun 29 08:06:53.461311 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 250/485] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 29 08:06:53 2022] GET /compute/v2.1/servers/f99567d1-cadf-40c5-b1dc-f86739b2b16c => generated 1810 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:06:53.836610 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-4d7bf34e-0b3c-438c-8e67-ce171eddde3a tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c70c44993ab240b1a5231df4c9d550c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e0c37d941434569b3dbd07e22125210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:06:53.851570 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-c1e8720f-8ba1-4179-9642-6137a4202a6a tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:06:53.852193 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-c1e8720f-8ba1-4179-9642-6137a4202a6a tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] [instance: c6c089a8-9bde-42b2-aa4e-014dcc9a6a30] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:06:53.855607 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-4d7bf34e-0b3c-438c-8e67-ce171eddde3a tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] 10.222.0.43 "GET /compute/v2.1/servers/d5d97f9b-3f4a-4a5e-89e8-98d55412fe71" status: 200 len: 1677 microversion: 2.1 time: 0.510789 Jun 29 08:06:53.864246 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 236/486] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:06:53 2022] GET /compute/v2.1/servers/d5d97f9b-3f4a-4a5e-89e8-98d55412fe71 => generated 1677 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 08:06:53.867501 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c1e8720f-8ba1-4179-9642-6137a4202a6a tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:53.868226 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c1e8720f-8ba1-4179-9642-6137a4202a6a tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:53.869090 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c1e8720f-8ba1-4179-9642-6137a4202a6a tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:53.869536 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c1e8720f-8ba1-4179-9642-6137a4202a6a tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:54.215042 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-c1e8720f-8ba1-4179-9642-6137a4202a6a tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1feaba97f594ffda9dd2962bebdc082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdadf97d44048c3bec51c0ae58ee4a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:06:54.226915 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-c1e8720f-8ba1-4179-9642-6137a4202a6a tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] 10.222.0.43 "GET /compute/v2.1/servers/c6c089a8-9bde-42b2-aa4e-014dcc9a6a30" status: 200 len: 1508 microversion: 2.1 time: 0.379159 Jun 29 08:06:54.239879 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 251/487] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:06:53 2022] GET /compute/v2.1/servers/c6c089a8-9bde-42b2-aa4e-014dcc9a6a30 => generated 1508 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:06:54.251174 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-a807b15c-296a-4f37-b6cb-46858f8ac67c tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "46eb6a1e-5cdc-4262-b411-4065471435a8", "device": "/dev/sdb"}} {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:06:54.254551 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-a807b15c-296a-4f37-b6cb-46858f8ac67c tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] [instance: c6c089a8-9bde-42b2-aa4e-014dcc9a6a30] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:06:54.267883 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-a807b15c-296a-4f37-b6cb-46858f8ac67c tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:54.269604 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-a807b15c-296a-4f37-b6cb-46858f8ac67c tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:54.271319 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-a807b15c-296a-4f37-b6cb-46858f8ac67c tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:54.272342 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-a807b15c-296a-4f37-b6cb-46858f8ac67c tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:54.481477 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-ae04f441-b0b1-4a27-a3a5-7cc2bcb6b37b tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:06:54.482305 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-ae04f441-b0b1-4a27-a3a5-7cc2bcb6b37b tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] [instance: f99567d1-cadf-40c5-b1dc-f86739b2b16c] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:06:54.498300 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ae04f441-b0b1-4a27-a3a5-7cc2bcb6b37b tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:54.498755 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ae04f441-b0b1-4a27-a3a5-7cc2bcb6b37b tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:54.499695 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ae04f441-b0b1-4a27-a3a5-7cc2bcb6b37b tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:54.500680 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ae04f441-b0b1-4a27-a3a5-7cc2bcb6b37b tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:54.702731 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-ae04f441-b0b1-4a27-a3a5-7cc2bcb6b37b tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:06:54.714307 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-ae04f441-b0b1-4a27-a3a5-7cc2bcb6b37b tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:06:54.716170 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-ae04f441-b0b1-4a27-a3a5-7cc2bcb6b37b tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:06:54.717432 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-ae04f441-b0b1-4a27-a3a5-7cc2bcb6b37b tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] 10.222.0.43 "GET /compute/v2.1/servers/f99567d1-cadf-40c5-b1dc-f86739b2b16c" status: 200 len: 1810 microversion: 2.20 time: 0.241836 Jun 29 08:06:54.729005 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 252/488] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 29 08:06:54 2022] GET /compute/v2.1/servers/f99567d1-cadf-40c5-b1dc-f86739b2b16c => generated 1810 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 29 08:06:54.729005 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [req-20351074-c5e5-4eb9-ae28-24a127a81907 req-7caba1c8-0332-4edf-860f-55a968b077a3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "83a86ef0-c066-44a7-b4eb-e32dce6e0069", "tag": "3828b918-ada6-49b4-b99e-2bfa66c92b2d"}]} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:06:54.729346 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:06:54.734536 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-20351074-c5e5-4eb9-ae28-24a127a81907 req-7caba1c8-0332-4edf-860f-55a968b077a3 service nova] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:54.735340 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-20351074-c5e5-4eb9-ae28-24a127a81907 req-7caba1c8-0332-4edf-860f-55a968b077a3 service nova] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:54.751348 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.compute.server_external_events [req-20351074-c5e5-4eb9-ae28-24a127a81907 req-7caba1c8-0332-4edf-860f-55a968b077a3 service nova] Creating event network-changed:3828b918-ada6-49b4-b99e-2bfa66c92b2d for instance 83a86ef0-c066-44a7-b4eb-e32dce6e0069 on hv-cinder-76810 Jun 29 08:06:54.757300 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [req-20351074-c5e5-4eb9-ae28-24a127a81907 req-7caba1c8-0332-4edf-860f-55a968b077a3 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036423 Jun 29 08:06:54.758350 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 253/489] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jun 29 08:06:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:06:54.875535 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-18496aae-0028-4602-aa6c-efbb62d592af tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:06:54.876272 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-18496aae-0028-4602-aa6c-efbb62d592af tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] [instance: d5d97f9b-3f4a-4a5e-89e8-98d55412fe71] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:06:54.885705 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-18496aae-0028-4602-aa6c-efbb62d592af tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:54.886168 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-18496aae-0028-4602-aa6c-efbb62d592af tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:54.886968 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-18496aae-0028-4602-aa6c-efbb62d592af tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:54.887412 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-18496aae-0028-4602-aa6c-efbb62d592af tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:55.086223 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-18496aae-0028-4602-aa6c-efbb62d592af tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c70c44993ab240b1a5231df4c9d550c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e0c37d941434569b3dbd07e22125210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:06:55.089353 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_cell1:SELECT=100 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:06:55.097007 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-18496aae-0028-4602-aa6c-efbb62d592af tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] 10.222.0.43 "GET /compute/v2.1/servers/d5d97f9b-3f4a-4a5e-89e8-98d55412fe71" status: 200 len: 1677 microversion: 2.1 time: 0.226502 Jun 29 08:06:55.099043 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 254/490] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:06:54 2022] GET /compute/v2.1/servers/d5d97f9b-3f4a-4a5e-89e8-98d55412fe71 => generated 1677 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 08:06:55.405973 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [req-ef0ddaa7-03b3-45e5-b454-b1a457619078 req-947d0299-577f-4c72-8d93-848cdd2b02ab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a523b7d-76fc-4f57-9bfe-c9c2b4b0b8c8", "tag": "1315c7c2-f10d-4890-8b5e-93890c37db42"}]} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:06:55.455174 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-ef0ddaa7-03b3-45e5-b454-b1a457619078 req-947d0299-577f-4c72-8d93-848cdd2b02ab service nova] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:55.461922 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-ef0ddaa7-03b3-45e5-b454-b1a457619078 req-947d0299-577f-4c72-8d93-848cdd2b02ab service nova] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:55.526969 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.compute.server_external_events [req-ef0ddaa7-03b3-45e5-b454-b1a457619078 req-947d0299-577f-4c72-8d93-848cdd2b02ab service nova] Creating event network-changed:1315c7c2-f10d-4890-8b5e-93890c37db42 for instance 4a523b7d-76fc-4f57-9bfe-c9c2b4b0b8c8 on hv-cinder-76810 Jun 29 08:06:55.548750 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [req-ef0ddaa7-03b3-45e5-b454-b1a457619078 req-947d0299-577f-4c72-8d93-848cdd2b02ab service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.152802 Jun 29 08:06:55.555000 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 255/491] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jun 29 08:06:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 29 08:06:55.733616 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-a807b15c-296a-4f37-b6cb-46858f8ac67c tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] 10.222.0.43 "POST /compute/v2.1/servers/c6c089a8-9bde-42b2-aa4e-014dcc9a6a30/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.490662 Jun 29 08:06:55.737452 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 237/492] 10.222.0.43 () {60 vars in 1322 bytes} [Wed Jun 29 08:06:54 2022] POST /compute/v2.1/servers/c6c089a8-9bde-42b2-aa4e-014dcc9a6a30/os-volume_attachments => generated 194 bytes in 1496 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:06:55.748516 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-1d8b6f09-6405-44c1-b840-7fa4d881ea76 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:06:55.754430 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-1d8b6f09-6405-44c1-b840-7fa4d881ea76 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] [instance: f99567d1-cadf-40c5-b1dc-f86739b2b16c] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:06:55.776683 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-1d8b6f09-6405-44c1-b840-7fa4d881ea76 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:55.777531 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-1d8b6f09-6405-44c1-b840-7fa4d881ea76 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:55.790759 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-1d8b6f09-6405-44c1-b840-7fa4d881ea76 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:55.791397 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-1d8b6f09-6405-44c1-b840-7fa4d881ea76 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:56.071332 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-1d8b6f09-6405-44c1-b840-7fa4d881ea76 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:06:56.082318 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-1d8b6f09-6405-44c1-b840-7fa4d881ea76 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:06:56.086058 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-1d8b6f09-6405-44c1-b840-7fa4d881ea76 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:06:56.087724 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-1d8b6f09-6405-44c1-b840-7fa4d881ea76 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] 10.222.0.43 "GET /compute/v2.1/servers/f99567d1-cadf-40c5-b1dc-f86739b2b16c" status: 200 len: 1810 microversion: 2.20 time: 0.348224 Jun 29 08:06:56.088869 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 256/493] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 29 08:06:55 2022] GET /compute/v2.1/servers/f99567d1-cadf-40c5-b1dc-f86739b2b16c => generated 1810 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:06:56.121782 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-aca2fae3-94af-45b5-8291-6be31212fa2a tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:06:56.123075 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-aca2fae3-94af-45b5-8291-6be31212fa2a tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] [instance: d5d97f9b-3f4a-4a5e-89e8-98d55412fe71] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:06:56.145500 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-aca2fae3-94af-45b5-8291-6be31212fa2a tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:56.146633 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-aca2fae3-94af-45b5-8291-6be31212fa2a tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:56.149315 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-aca2fae3-94af-45b5-8291-6be31212fa2a tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:56.150113 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-aca2fae3-94af-45b5-8291-6be31212fa2a tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:56.353260 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-aca2fae3-94af-45b5-8291-6be31212fa2a tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c70c44993ab240b1a5231df4c9d550c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e0c37d941434569b3dbd07e22125210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:06:56.364031 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-aca2fae3-94af-45b5-8291-6be31212fa2a tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] 10.222.0.43 "GET /compute/v2.1/servers/d5d97f9b-3f4a-4a5e-89e8-98d55412fe71" status: 200 len: 1677 microversion: 2.1 time: 0.250795 Jun 29 08:06:56.369663 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 238/494] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:06:56 2022] GET /compute/v2.1/servers/d5d97f9b-3f4a-4a5e-89e8-98d55412fe71 => generated 1677 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:06:57.120222 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-4facda64-76c8-4656-a41b-e620fa0d1873 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:06:57.121031 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-4facda64-76c8-4656-a41b-e620fa0d1873 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] [instance: f99567d1-cadf-40c5-b1dc-f86739b2b16c] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:06:57.135728 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-4facda64-76c8-4656-a41b-e620fa0d1873 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:57.136591 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-4facda64-76c8-4656-a41b-e620fa0d1873 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:57.138143 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-4facda64-76c8-4656-a41b-e620fa0d1873 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:57.138697 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-4facda64-76c8-4656-a41b-e620fa0d1873 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:57.388601 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-4830a3f1-7a29-40ab-a2e0-573dbe892701 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:06:57.394185 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-4830a3f1-7a29-40ab-a2e0-573dbe892701 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] [instance: d5d97f9b-3f4a-4a5e-89e8-98d55412fe71] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:06:57.421715 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-4830a3f1-7a29-40ab-a2e0-573dbe892701 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:57.423630 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-4830a3f1-7a29-40ab-a2e0-573dbe892701 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:57.427377 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-4830a3f1-7a29-40ab-a2e0-573dbe892701 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:57.430824 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-4830a3f1-7a29-40ab-a2e0-573dbe892701 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:57.914850 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-4830a3f1-7a29-40ab-a2e0-573dbe892701 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c70c44993ab240b1a5231df4c9d550c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e0c37d941434569b3dbd07e22125210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:06:57.946115 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-4830a3f1-7a29-40ab-a2e0-573dbe892701 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] 10.222.0.43 "GET /compute/v2.1/servers/d5d97f9b-3f4a-4a5e-89e8-98d55412fe71" status: 200 len: 1677 microversion: 2.1 time: 0.566279 Jun 29 08:06:57.956487 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-4facda64-76c8-4656-a41b-e620fa0d1873 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:06:57.960032 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 239/495] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:06:57 2022] GET /compute/v2.1/servers/d5d97f9b-3f4a-4a5e-89e8-98d55412fe71 => generated 1677 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 08:06:57.966415 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-4facda64-76c8-4656-a41b-e620fa0d1873 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:06:57.974082 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-4facda64-76c8-4656-a41b-e620fa0d1873 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:06:57.976589 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-4facda64-76c8-4656-a41b-e620fa0d1873 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] 10.222.0.43 "GET /compute/v2.1/servers/f99567d1-cadf-40c5-b1dc-f86739b2b16c" status: 200 len: 1810 microversion: 2.20 time: 0.861431 Jun 29 08:06:57.978702 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 257/496] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 29 08:06:57 2022] GET /compute/v2.1/servers/f99567d1-cadf-40c5-b1dc-f86739b2b16c => generated 1810 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:06:58.016959 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-253ae8ac-834d-40b6-ab00-b68d231268eb tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-260344434"}} {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:06:58.017632 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-253ae8ac-834d-40b6-ab00-b68d231268eb tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] [instance: 4a523b7d-76fc-4f57-9bfe-c9c2b4b0b8c8] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:06:58.027727 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-253ae8ac-834d-40b6-ab00-b68d231268eb tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:58.028275 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-253ae8ac-834d-40b6-ab00-b68d231268eb tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:58.029453 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-253ae8ac-834d-40b6-ab00-b68d231268eb tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:58.030587 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-253ae8ac-834d-40b6-ab00-b68d231268eb tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:58.307531 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.network.security_group_api [None req-253ae8ac-834d-40b6-ab00-b68d231268eb tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Adding security group e5616007-85ed-4da9-9eed-331121f2f244 to port 1315c7c2-f10d-4890-8b5e-93890c37db42 Jun 29 08:06:58.773052 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-253ae8ac-834d-40b6-ab00-b68d231268eb tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] 10.222.0.43 "POST /compute/v2.1/servers/4a523b7d-76fc-4f57-9bfe-c9c2b4b0b8c8/action" status: 202 len: 0 microversion: 2.1 time: 0.764237 Jun 29 08:06:58.774181 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 240/497] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Jun 29 08:06:58 2022] POST /compute/v2.1/servers/4a523b7d-76fc-4f57-9bfe-c9c2b4b0b8c8/action => generated 0 bytes in 766 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 29 08:06:58.785223 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-45002619-a37e-4466-b276-7ff235157d8d tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:06:58.786015 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-45002619-a37e-4466-b276-7ff235157d8d tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] [instance: 4a523b7d-76fc-4f57-9bfe-c9c2b4b0b8c8] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:06:58.789717 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [req-af56547e-b6f6-4de9-9a44-752eab7dbdfa req-027bcd7b-1490-471a-9539-0dba2187eb16 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a523b7d-76fc-4f57-9bfe-c9c2b4b0b8c8", "tag": "1315c7c2-f10d-4890-8b5e-93890c37db42"}]} {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:06:58.802988 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-45002619-a37e-4466-b276-7ff235157d8d tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:58.803442 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-45002619-a37e-4466-b276-7ff235157d8d tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:58.805947 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [req-af56547e-b6f6-4de9-9a44-752eab7dbdfa req-027bcd7b-1490-471a-9539-0dba2187eb16 service nova] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:58.806491 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [req-af56547e-b6f6-4de9-9a44-752eab7dbdfa req-027bcd7b-1490-471a-9539-0dba2187eb16 service nova] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:58.807333 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-45002619-a37e-4466-b276-7ff235157d8d tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:58.814147 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-45002619-a37e-4466-b276-7ff235157d8d tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:58.820888 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.compute.server_external_events [req-af56547e-b6f6-4de9-9a44-752eab7dbdfa req-027bcd7b-1490-471a-9539-0dba2187eb16 service nova] Creating event network-changed:1315c7c2-f10d-4890-8b5e-93890c37db42 for instance 4a523b7d-76fc-4f57-9bfe-c9c2b4b0b8c8 on hv-cinder-76810 Jun 29 08:06:58.826295 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [req-af56547e-b6f6-4de9-9a44-752eab7dbdfa req-027bcd7b-1490-471a-9539-0dba2187eb16 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046113 Jun 29 08:06:58.830543 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 241/498] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jun 29 08:06:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:06:58.972261 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-ad4b2a15-d00e-46c9-a887-e08389498b8e tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:06:58.974473 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-ad4b2a15-d00e-46c9-a887-e08389498b8e tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] [instance: d5d97f9b-3f4a-4a5e-89e8-98d55412fe71] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:06:58.996837 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-ad4b2a15-d00e-46c9-a887-e08389498b8e tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:58.998780 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-ad4b2a15-d00e-46c9-a887-e08389498b8e tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:59.001648 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-ad4b2a15-d00e-46c9-a887-e08389498b8e tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:59.003260 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-ad4b2a15-d00e-46c9-a887-e08389498b8e tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:59.043054 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-45002619-a37e-4466-b276-7ff235157d8d tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6663857e60ca4440a9a620007be4c2c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7afb1bdb06042f4b983631745f32e19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:06:59.053959 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-45002619-a37e-4466-b276-7ff235157d8d tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] 10.222.0.43 "GET /compute/v2.1/servers/4a523b7d-76fc-4f57-9bfe-c9c2b4b0b8c8" status: 200 len: 1757 microversion: 2.1 time: 0.274100 Jun 29 08:06:59.061163 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 258/499] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:06:58 2022] GET /compute/v2.1/servers/4a523b7d-76fc-4f57-9bfe-c9c2b4b0b8c8 => generated 1757 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:06:59.072690 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-9b4ba72b-09a7-4a35-9fd9-3be3fb6418ac tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:06:59.074194 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-9b4ba72b-09a7-4a35-9fd9-3be3fb6418ac tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] [instance: f99567d1-cadf-40c5-b1dc-f86739b2b16c] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:06:59.082763 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-9b4ba72b-09a7-4a35-9fd9-3be3fb6418ac tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:59.083456 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-9b4ba72b-09a7-4a35-9fd9-3be3fb6418ac tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:59.084423 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-9b4ba72b-09a7-4a35-9fd9-3be3fb6418ac tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:06:59.085215 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-9b4ba72b-09a7-4a35-9fd9-3be3fb6418ac tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:06:59.271170 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-9b4ba72b-09a7-4a35-9fd9-3be3fb6418ac tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:06:59.287789 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-9b4ba72b-09a7-4a35-9fd9-3be3fb6418ac tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:06:59.289799 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-9b4ba72b-09a7-4a35-9fd9-3be3fb6418ac tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:06:59.292177 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-9b4ba72b-09a7-4a35-9fd9-3be3fb6418ac tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] 10.222.0.43 "GET /compute/v2.1/servers/f99567d1-cadf-40c5-b1dc-f86739b2b16c" status: 200 len: 1797 microversion: 2.20 time: 0.229247 Jun 29 08:06:59.293065 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 259/500] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 29 08:06:59 2022] GET /compute/v2.1/servers/f99567d1-cadf-40c5-b1dc-f86739b2b16c => generated 1797 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:06:59.334353 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-ad4b2a15-d00e-46c9-a887-e08389498b8e tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c70c44993ab240b1a5231df4c9d550c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e0c37d941434569b3dbd07e22125210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:06:59.342635 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-ad4b2a15-d00e-46c9-a887-e08389498b8e tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] 10.222.0.43 "GET /compute/v2.1/servers/d5d97f9b-3f4a-4a5e-89e8-98d55412fe71" status: 200 len: 1677 microversion: 2.1 time: 0.379063 Jun 29 08:06:59.343353 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 242/501] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:06:58 2022] GET /compute/v2.1/servers/d5d97f9b-3f4a-4a5e-89e8-98d55412fe71 => generated 1677 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:07:00.360574 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-b45a8e31-23be-445f-bc42-7bc1a876cb6e tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:07:00.361425 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-b45a8e31-23be-445f-bc42-7bc1a876cb6e tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] [instance: d5d97f9b-3f4a-4a5e-89e8-98d55412fe71] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:07:00.368224 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-b45a8e31-23be-445f-bc42-7bc1a876cb6e tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:07:00.368677 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-b45a8e31-23be-445f-bc42-7bc1a876cb6e tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:07:00.369502 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-b45a8e31-23be-445f-bc42-7bc1a876cb6e tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:07:00.369950 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-b45a8e31-23be-445f-bc42-7bc1a876cb6e tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:07:00.519778 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-b45a8e31-23be-445f-bc42-7bc1a876cb6e tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c70c44993ab240b1a5231df4c9d550c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e0c37d941434569b3dbd07e22125210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:07:00.527743 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-b45a8e31-23be-445f-bc42-7bc1a876cb6e tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] 10.222.0.43 "GET /compute/v2.1/servers/d5d97f9b-3f4a-4a5e-89e8-98d55412fe71" status: 200 len: 1654 microversion: 2.1 time: 0.171756 Jun 29 08:07:00.528357 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 260/502] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:07:00 2022] GET /compute/v2.1/servers/d5d97f9b-3f4a-4a5e-89e8-98d55412fe71 => generated 1654 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:07:00.546528 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-b70f11b8-72b9-4e14-89de-f4fa0ef1a657 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:07:00.554546 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-b70f11b8-72b9-4e14-89de-f4fa0ef1a657 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:07:00.554987 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-b70f11b8-72b9-4e14-89de-f4fa0ef1a657 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:07:00.588595 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-b70f11b8-72b9-4e14-89de-f4fa0ef1a657 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] [instance: d5d97f9b-3f4a-4a5e-89e8-98d55412fe71] Going to try to start instance {{(pid=117890) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 29 08:07:00.636354 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-b70f11b8-72b9-4e14-89de-f4fa0ef1a657 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] 10.222.0.43 "POST /compute/v2.1/servers/d5d97f9b-3f4a-4a5e-89e8-98d55412fe71/action" status: 202 len: 0 microversion: 2.1 time: 0.094046 Jun 29 08:07:00.637209 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 243/503] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Jun 29 08:07:00 2022] POST /compute/v2.1/servers/d5d97f9b-3f4a-4a5e-89e8-98d55412fe71/action => generated 0 bytes in 96 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 29 08:07:00.647912 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-49bf4507-eb90-429c-be07-050c447b3198 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:07:00.649058 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-49bf4507-eb90-429c-be07-050c447b3198 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] [instance: d5d97f9b-3f4a-4a5e-89e8-98d55412fe71] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:07:00.658625 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-49bf4507-eb90-429c-be07-050c447b3198 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:07:00.659364 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-49bf4507-eb90-429c-be07-050c447b3198 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:07:00.660421 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-49bf4507-eb90-429c-be07-050c447b3198 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:07:00.661039 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-49bf4507-eb90-429c-be07-050c447b3198 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:07:00.840672 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-49bf4507-eb90-429c-be07-050c447b3198 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c70c44993ab240b1a5231df4c9d550c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e0c37d941434569b3dbd07e22125210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:07:00.851090 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-49bf4507-eb90-429c-be07-050c447b3198 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] 10.222.0.43 "GET /compute/v2.1/servers/d5d97f9b-3f4a-4a5e-89e8-98d55412fe71" status: 200 len: 1663 microversion: 2.1 time: 0.208493 Jun 29 08:07:00.851935 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 261/504] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:07:00 2022] GET /compute/v2.1/servers/d5d97f9b-3f4a-4a5e-89e8-98d55412fe71 => generated 1663 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 08:07:01.870609 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-c9056dc2-18c5-4feb-b31b-98b545f37080 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:07:01.871346 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-c9056dc2-18c5-4feb-b31b-98b545f37080 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] [instance: d5d97f9b-3f4a-4a5e-89e8-98d55412fe71] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:07:01.878270 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-c9056dc2-18c5-4feb-b31b-98b545f37080 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:07:01.878722 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-c9056dc2-18c5-4feb-b31b-98b545f37080 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:07:01.879501 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-c9056dc2-18c5-4feb-b31b-98b545f37080 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:07:01.879945 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-c9056dc2-18c5-4feb-b31b-98b545f37080 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:07:02.043672 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-c9056dc2-18c5-4feb-b31b-98b545f37080 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c70c44993ab240b1a5231df4c9d550c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e0c37d941434569b3dbd07e22125210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:07:02.052767 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-c9056dc2-18c5-4feb-b31b-98b545f37080 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] 10.222.0.43 "GET /compute/v2.1/servers/d5d97f9b-3f4a-4a5e-89e8-98d55412fe71" status: 200 len: 1663 microversion: 2.1 time: 0.186430 Jun 29 08:07:02.053374 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 244/505] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:07:01 2022] GET /compute/v2.1/servers/d5d97f9b-3f4a-4a5e-89e8-98d55412fe71 => generated 1663 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:07:03.071207 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-6c547ef8-d0b6-42e7-984b-1a2823383e2e tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:07:03.071841 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-6c547ef8-d0b6-42e7-984b-1a2823383e2e tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] [instance: d5d97f9b-3f4a-4a5e-89e8-98d55412fe71] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:07:03.078611 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-6c547ef8-d0b6-42e7-984b-1a2823383e2e tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:07:03.079270 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-6c547ef8-d0b6-42e7-984b-1a2823383e2e tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:07:03.080063 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-6c547ef8-d0b6-42e7-984b-1a2823383e2e tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:07:03.080546 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-6c547ef8-d0b6-42e7-984b-1a2823383e2e tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:07:03.221839 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-6c547ef8-d0b6-42e7-984b-1a2823383e2e tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c70c44993ab240b1a5231df4c9d550c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e0c37d941434569b3dbd07e22125210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:07:03.229853 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-6c547ef8-d0b6-42e7-984b-1a2823383e2e tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] 10.222.0.43 "GET /compute/v2.1/servers/d5d97f9b-3f4a-4a5e-89e8-98d55412fe71" status: 200 len: 1667 microversion: 2.1 time: 0.162591 Jun 29 08:07:03.230432 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 262/506] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:07:03 2022] GET /compute/v2.1/servers/d5d97f9b-3f4a-4a5e-89e8-98d55412fe71 => generated 1667 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 08:07:06.536573 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-451e8d4c-2bd5-4da9-9592-78df921b8c2d tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1b642988-5e5b-4d1e-ae54-55773584effe"}} {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:07:06.537678 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-451e8d4c-2bd5-4da9-9592-78df921b8c2d tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] [instance: ca231b38-fd3e-43ba-9cba-1de10a1ffeec] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:07:06.544638 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-451e8d4c-2bd5-4da9-9592-78df921b8c2d tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:07:06.545046 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-451e8d4c-2bd5-4da9-9592-78df921b8c2d tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:07:06.545838 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-451e8d4c-2bd5-4da9-9592-78df921b8c2d tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:07:06.546328 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-451e8d4c-2bd5-4da9-9592-78df921b8c2d tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:07:09.048379 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-451e8d4c-2bd5-4da9-9592-78df921b8c2d tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] 10.222.0.43 "POST /compute/v2.1/servers/ca231b38-fd3e-43ba-9cba-1de10a1ffeec/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.515672 Jun 29 08:07:09.049113 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 245/507] 10.222.0.43 () {60 vars in 1322 bytes} [Wed Jun 29 08:07:06 2022] POST /compute/v2.1/servers/ca231b38-fd3e-43ba-9cba-1de10a1ffeec/os-volume_attachments => generated 194 bytes in 2517 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:07:16.584090 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-ea7828cc-983a-4fc3-bf06-4fa823c9405b tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:07:16.585116 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-ea7828cc-983a-4fc3-bf06-4fa823c9405b tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] [instance: ca231b38-fd3e-43ba-9cba-1de10a1ffeec] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:07:16.587822 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_api:SELECT=19 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:07:16.588542 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_cell1:SELECT=45 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:07:16.595597 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ea7828cc-983a-4fc3-bf06-4fa823c9405b tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:07:16.596059 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ea7828cc-983a-4fc3-bf06-4fa823c9405b tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:07:16.596838 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ea7828cc-983a-4fc3-bf06-4fa823c9405b tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:07:16.597308 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ea7828cc-983a-4fc3-bf06-4fa823c9405b tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:07:16.620966 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.objects.instance [None req-ea7828cc-983a-4fc3-bf06-4fa823c9405b tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lazy-loading 'flavor' on Instance uuid ca231b38-fd3e-43ba-9cba-1de10a1ffeec {{(pid=117889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 29 08:07:16.752260 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-ea7828cc-983a-4fc3-bf06-4fa823c9405b tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] 10.222.0.43 "POST /compute/v2.1/servers/ca231b38-fd3e-43ba-9cba-1de10a1ffeec/action" status: 200 len: 32 microversion: 2.1 time: 0.172608 Jun 29 08:07:16.752875 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 263/508] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Jun 29 08:07:16 2022] POST /compute/v2.1/servers/ca231b38-fd3e-43ba-9cba-1de10a1ffeec/action => generated 32 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 29 08:07:16.760367 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG dbcounter [-] [117890] Writing DB stats nova_api:SELECT=19 {{(pid=117890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:07:16.765766 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-11f7bb75-38fc-447c-9a96-e81c783aff85 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:07:16.766556 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-11f7bb75-38fc-447c-9a96-e81c783aff85 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] [instance: ca231b38-fd3e-43ba-9cba-1de10a1ffeec] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:07:16.774218 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-11f7bb75-38fc-447c-9a96-e81c783aff85 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:07:16.774729 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-11f7bb75-38fc-447c-9a96-e81c783aff85 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:07:16.775568 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-11f7bb75-38fc-447c-9a96-e81c783aff85 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:07:16.776345 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-11f7bb75-38fc-447c-9a96-e81c783aff85 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:07:16.779152 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG dbcounter [-] [117890] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=117890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:07:17.025076 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-11f7bb75-38fc-447c-9a96-e81c783aff85 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4af4eedee24897be2e702ef51873b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab693125979f4bb7b7b3c94061610fe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:07:17.034271 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-11f7bb75-38fc-447c-9a96-e81c783aff85 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] 10.222.0.43 "GET /compute/v2.1/servers/ca231b38-fd3e-43ba-9cba-1de10a1ffeec" status: 200 len: 1734 microversion: 2.1 time: 0.275447 Jun 29 08:07:17.034866 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 246/509] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:07:16 2022] GET /compute/v2.1/servers/ca231b38-fd3e-43ba-9cba-1de10a1ffeec => generated 1734 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:07:17.568525 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-f024eb99-c71b-4da4-b0e8-188739bdcdd4 tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:07:17.569145 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-f024eb99-c71b-4da4-b0e8-188739bdcdd4 tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] [instance: c6c089a8-9bde-42b2-aa4e-014dcc9a6a30] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:07:17.575660 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-f024eb99-c71b-4da4-b0e8-188739bdcdd4 tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:07:17.576112 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-f024eb99-c71b-4da4-b0e8-188739bdcdd4 tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:07:17.576900 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-f024eb99-c71b-4da4-b0e8-188739bdcdd4 tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:07:17.577373 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-f024eb99-c71b-4da4-b0e8-188739bdcdd4 tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:07:17.681062 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.objects.instance [None req-f024eb99-c71b-4da4-b0e8-188739bdcdd4 tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Lazy-loading 'services' on Instance uuid c6c089a8-9bde-42b2-aa4e-014dcc9a6a30 {{(pid=117889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 29 08:07:17.778560 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-f024eb99-c71b-4da4-b0e8-188739bdcdd4 tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] 10.222.0.43 "DELETE /compute/v2.1/servers/c6c089a8-9bde-42b2-aa4e-014dcc9a6a30/os-volume_attachments/46eb6a1e-5cdc-4262-b411-4065471435a8" status: 202 len: 0 microversion: 2.1 time: 0.214220 Jun 29 08:07:17.779211 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 264/510] 10.222.0.43 () {58 vars in 1415 bytes} [Wed Jun 29 08:07:17 2022] DELETE /compute/v2.1/servers/c6c089a8-9bde-42b2-aa4e-014dcc9a6a30/os-volume_attachments/46eb6a1e-5cdc-4262-b411-4065471435a8 => generated 0 bytes in 216 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 29 08:07:18.053871 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-3551c5b5-6e01-4a3f-b09f-c8c591f76e05 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:07:18.054789 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-3551c5b5-6e01-4a3f-b09f-c8c591f76e05 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] [instance: ca231b38-fd3e-43ba-9cba-1de10a1ffeec] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:07:18.063608 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-3551c5b5-6e01-4a3f-b09f-c8c591f76e05 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:07:18.064413 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-3551c5b5-6e01-4a3f-b09f-c8c591f76e05 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:07:18.065326 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-3551c5b5-6e01-4a3f-b09f-c8c591f76e05 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:07:18.066036 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-3551c5b5-6e01-4a3f-b09f-c8c591f76e05 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:07:18.206836 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-3551c5b5-6e01-4a3f-b09f-c8c591f76e05 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4af4eedee24897be2e702ef51873b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab693125979f4bb7b7b3c94061610fe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:07:18.215208 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-3551c5b5-6e01-4a3f-b09f-c8c591f76e05 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] 10.222.0.43 "GET /compute/v2.1/servers/ca231b38-fd3e-43ba-9cba-1de10a1ffeec" status: 200 len: 1734 microversion: 2.1 time: 0.167484 Jun 29 08:07:18.215801 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 247/511] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:07:18 2022] GET /compute/v2.1/servers/ca231b38-fd3e-43ba-9cba-1de10a1ffeec => generated 1734 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:07:19.233979 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-fd14b855-c97f-41d6-bf6c-5c02b79f3c75 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:07:19.234685 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-fd14b855-c97f-41d6-bf6c-5c02b79f3c75 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] [instance: ca231b38-fd3e-43ba-9cba-1de10a1ffeec] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:07:19.242417 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-fd14b855-c97f-41d6-bf6c-5c02b79f3c75 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:07:19.242870 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-fd14b855-c97f-41d6-bf6c-5c02b79f3c75 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:07:19.243648 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-fd14b855-c97f-41d6-bf6c-5c02b79f3c75 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:07:19.244090 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-fd14b855-c97f-41d6-bf6c-5c02b79f3c75 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:07:19.388757 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-fd14b855-c97f-41d6-bf6c-5c02b79f3c75 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4af4eedee24897be2e702ef51873b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab693125979f4bb7b7b3c94061610fe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:07:19.399110 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-fd14b855-c97f-41d6-bf6c-5c02b79f3c75 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] 10.222.0.43 "GET /compute/v2.1/servers/ca231b38-fd3e-43ba-9cba-1de10a1ffeec" status: 200 len: 1734 microversion: 2.1 time: 0.169892 Jun 29 08:07:19.399981 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 265/512] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:07:19 2022] GET /compute/v2.1/servers/ca231b38-fd3e-43ba-9cba-1de10a1ffeec => generated 1734 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:07:19.954440 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-486cd92c-4e42-4539-ad00-84cd77112666 tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:07:19.954981 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-486cd92c-4e42-4539-ad00-84cd77112666 tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] [instance: c6c089a8-9bde-42b2-aa4e-014dcc9a6a30] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:07:19.961538 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-486cd92c-4e42-4539-ad00-84cd77112666 tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:07:19.961981 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-486cd92c-4e42-4539-ad00-84cd77112666 tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:07:19.962750 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-486cd92c-4e42-4539-ad00-84cd77112666 tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:07:19.963179 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-486cd92c-4e42-4539-ad00-84cd77112666 tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:07:19.989491 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-486cd92c-4e42-4539-ad00-84cd77112666 tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] [instance: c6c089a8-9bde-42b2-aa4e-014dcc9a6a30] Going to try to terminate instance {{(pid=117890) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 29 08:07:20.088020 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-486cd92c-4e42-4539-ad00-84cd77112666 tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] 10.222.0.43 "DELETE /compute/v2.1/servers/c6c089a8-9bde-42b2-aa4e-014dcc9a6a30" status: 204 len: 0 microversion: 2.1 time: 0.137243 Jun 29 08:07:20.088649 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 248/513] 10.222.0.43 () {58 vars in 1238 bytes} [Wed Jun 29 08:07:19 2022] DELETE /compute/v2.1/servers/c6c089a8-9bde-42b2-aa4e-014dcc9a6a30 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 29 08:07:20.102052 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-d961173a-afc8-4d7a-b850-9724ee554e4e tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:07:20.102675 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-d961173a-afc8-4d7a-b850-9724ee554e4e tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] [instance: c6c089a8-9bde-42b2-aa4e-014dcc9a6a30] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:07:20.111952 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-d961173a-afc8-4d7a-b850-9724ee554e4e tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:07:20.112396 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-d961173a-afc8-4d7a-b850-9724ee554e4e tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:07:20.113218 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-d961173a-afc8-4d7a-b850-9724ee554e4e tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:07:20.113664 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-d961173a-afc8-4d7a-b850-9724ee554e4e tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:07:20.268349 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-d961173a-afc8-4d7a-b850-9724ee554e4e tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1feaba97f594ffda9dd2962bebdc082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdadf97d44048c3bec51c0ae58ee4a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:07:20.280138 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-d961173a-afc8-4d7a-b850-9724ee554e4e tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] 10.222.0.43 "GET /compute/v2.1/servers/c6c089a8-9bde-42b2-aa4e-014dcc9a6a30" status: 200 len: 1514 microversion: 2.1 time: 0.184376 Jun 29 08:07:20.280970 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 266/514] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:07:20 2022] GET /compute/v2.1/servers/c6c089a8-9bde-42b2-aa4e-014dcc9a6a30 => generated 1514 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:07:20.420421 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-9c676996-e681-4fc7-97fd-4363fb0b39b5 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:07:20.421215 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-9c676996-e681-4fc7-97fd-4363fb0b39b5 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] [instance: ca231b38-fd3e-43ba-9cba-1de10a1ffeec] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:07:20.430071 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-9c676996-e681-4fc7-97fd-4363fb0b39b5 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:07:20.430724 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-9c676996-e681-4fc7-97fd-4363fb0b39b5 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:07:20.431624 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-9c676996-e681-4fc7-97fd-4363fb0b39b5 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:07:20.432060 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-9c676996-e681-4fc7-97fd-4363fb0b39b5 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:07:20.585288 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-9c676996-e681-4fc7-97fd-4363fb0b39b5 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4af4eedee24897be2e702ef51873b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab693125979f4bb7b7b3c94061610fe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:07:20.593810 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-9c676996-e681-4fc7-97fd-4363fb0b39b5 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] 10.222.0.43 "GET /compute/v2.1/servers/ca231b38-fd3e-43ba-9cba-1de10a1ffeec" status: 200 len: 1734 microversion: 2.1 time: 0.177644 Jun 29 08:07:20.595195 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 249/515] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:07:20 2022] GET /compute/v2.1/servers/ca231b38-fd3e-43ba-9cba-1de10a1ffeec => generated 1734 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:07:21.299167 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-6ef45bf8-cf0e-461c-932d-38bf6e7466ba tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:07:21.299858 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-6ef45bf8-cf0e-461c-932d-38bf6e7466ba tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] [instance: c6c089a8-9bde-42b2-aa4e-014dcc9a6a30] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:07:21.306629 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-6ef45bf8-cf0e-461c-932d-38bf6e7466ba tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:07:21.307095 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-6ef45bf8-cf0e-461c-932d-38bf6e7466ba tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:07:21.307868 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-6ef45bf8-cf0e-461c-932d-38bf6e7466ba tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:07:21.308300 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-6ef45bf8-cf0e-461c-932d-38bf6e7466ba tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:07:21.449382 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-6ef45bf8-cf0e-461c-932d-38bf6e7466ba tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1feaba97f594ffda9dd2962bebdc082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdadf97d44048c3bec51c0ae58ee4a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:07:21.457890 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-6ef45bf8-cf0e-461c-932d-38bf6e7466ba tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] 10.222.0.43 "GET /compute/v2.1/servers/c6c089a8-9bde-42b2-aa4e-014dcc9a6a30" status: 200 len: 1514 microversion: 2.1 time: 0.162761 Jun 29 08:07:21.458485 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 267/516] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:07:21 2022] GET /compute/v2.1/servers/c6c089a8-9bde-42b2-aa4e-014dcc9a6a30 => generated 1514 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 08:07:21.615507 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-971d6411-2536-4dba-b755-3bd705c577f7 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:07:21.616068 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-971d6411-2536-4dba-b755-3bd705c577f7 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] [instance: ca231b38-fd3e-43ba-9cba-1de10a1ffeec] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:07:21.622924 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-971d6411-2536-4dba-b755-3bd705c577f7 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:07:21.623378 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-971d6411-2536-4dba-b755-3bd705c577f7 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:07:21.624175 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-971d6411-2536-4dba-b755-3bd705c577f7 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:07:21.624618 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-971d6411-2536-4dba-b755-3bd705c577f7 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:07:21.784893 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-971d6411-2536-4dba-b755-3bd705c577f7 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4af4eedee24897be2e702ef51873b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab693125979f4bb7b7b3c94061610fe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:07:21.793116 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-971d6411-2536-4dba-b755-3bd705c577f7 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] 10.222.0.43 "GET /compute/v2.1/servers/ca231b38-fd3e-43ba-9cba-1de10a1ffeec" status: 200 len: 1734 microversion: 2.1 time: 0.183953 Jun 29 08:07:21.793701 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 250/517] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:07:21 2022] GET /compute/v2.1/servers/ca231b38-fd3e-43ba-9cba-1de10a1ffeec => generated 1734 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:07:22.478463 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-d286c842-361d-48c4-b582-e0b3e7133661 tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:07:22.479093 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-d286c842-361d-48c4-b582-e0b3e7133661 tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] [instance: c6c089a8-9bde-42b2-aa4e-014dcc9a6a30] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:07:22.485934 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-d286c842-361d-48c4-b582-e0b3e7133661 tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:07:22.486381 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-d286c842-361d-48c4-b582-e0b3e7133661 tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:07:22.487723 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-d286c842-361d-48c4-b582-e0b3e7133661 tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:07:22.487723 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-d286c842-361d-48c4-b582-e0b3e7133661 tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:07:22.627620 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-d286c842-361d-48c4-b582-e0b3e7133661 tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1feaba97f594ffda9dd2962bebdc082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdadf97d44048c3bec51c0ae58ee4a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:07:22.635691 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-d286c842-361d-48c4-b582-e0b3e7133661 tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] 10.222.0.43 "GET /compute/v2.1/servers/c6c089a8-9bde-42b2-aa4e-014dcc9a6a30" status: 200 len: 1514 microversion: 2.1 time: 0.161014 Jun 29 08:07:22.636277 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 268/518] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:07:22 2022] GET /compute/v2.1/servers/c6c089a8-9bde-42b2-aa4e-014dcc9a6a30 => generated 1514 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:07:22.811118 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-452966fd-b0f3-4e57-bf5c-615613400d59 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:07:22.811921 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-452966fd-b0f3-4e57-bf5c-615613400d59 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] [instance: ca231b38-fd3e-43ba-9cba-1de10a1ffeec] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:07:22.819389 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-452966fd-b0f3-4e57-bf5c-615613400d59 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:07:22.819841 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-452966fd-b0f3-4e57-bf5c-615613400d59 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:07:22.820613 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-452966fd-b0f3-4e57-bf5c-615613400d59 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:07:22.821087 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-452966fd-b0f3-4e57-bf5c-615613400d59 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:07:22.959884 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-452966fd-b0f3-4e57-bf5c-615613400d59 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4af4eedee24897be2e702ef51873b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab693125979f4bb7b7b3c94061610fe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:07:22.967917 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-452966fd-b0f3-4e57-bf5c-615613400d59 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] 10.222.0.43 "GET /compute/v2.1/servers/ca231b38-fd3e-43ba-9cba-1de10a1ffeec" status: 200 len: 1734 microversion: 2.1 time: 0.160815 Jun 29 08:07:22.968483 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 251/519] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:07:22 2022] GET /compute/v2.1/servers/ca231b38-fd3e-43ba-9cba-1de10a1ffeec => generated 1734 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 08:07:23.574496 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [req-1fb1879a-a0ae-487f-ab76-6fd69f091e82 req-59ace5fc-4e91-4287-ac76-c873c5e3d7a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c6c089a8-9bde-42b2-aa4e-014dcc9a6a30", "name": "network-vif-deleted", "tag": "fd0c00d6-7d1f-4a23-a222-4f83153cce1e"}]} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:07:23.586177 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-1fb1879a-a0ae-487f-ab76-6fd69f091e82 req-59ace5fc-4e91-4287-ac76-c873c5e3d7a5 service nova] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:07:23.586617 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-1fb1879a-a0ae-487f-ab76-6fd69f091e82 req-59ace5fc-4e91-4287-ac76-c873c5e3d7a5 service nova] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:07:23.599109 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.compute.server_external_events [req-1fb1879a-a0ae-487f-ab76-6fd69f091e82 req-59ace5fc-4e91-4287-ac76-c873c5e3d7a5 service nova] Creating event network-vif-deleted:fd0c00d6-7d1f-4a23-a222-4f83153cce1e for instance c6c089a8-9bde-42b2-aa4e-014dcc9a6a30 on hv-cinder-76810 Jun 29 08:07:23.604860 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [req-1fb1879a-a0ae-487f-ab76-6fd69f091e82 req-59ace5fc-4e91-4287-ac76-c873c5e3d7a5 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034117 Jun 29 08:07:23.605620 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 269/520] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jun 29 08:07:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:07:23.654407 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-e423ad27-fbe2-4c06-b098-8f133bf30bff tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:07:23.655101 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-e423ad27-fbe2-4c06-b098-8f133bf30bff tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] [instance: c6c089a8-9bde-42b2-aa4e-014dcc9a6a30] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:07:23.662089 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-e423ad27-fbe2-4c06-b098-8f133bf30bff tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:07:23.662541 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-e423ad27-fbe2-4c06-b098-8f133bf30bff tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:07:23.663328 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-e423ad27-fbe2-4c06-b098-8f133bf30bff tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:07:23.663766 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-e423ad27-fbe2-4c06-b098-8f133bf30bff tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:07:23.731497 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-e423ad27-fbe2-4c06-b098-8f133bf30bff tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1feaba97f594ffda9dd2962bebdc082', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bdadf97d44048c3bec51c0ae58ee4a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:07:23.743812 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-e423ad27-fbe2-4c06-b098-8f133bf30bff tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] 10.222.0.43 "GET /compute/v2.1/servers/c6c089a8-9bde-42b2-aa4e-014dcc9a6a30" status: 200 len: 1304 microversion: 2.1 time: 0.093951 Jun 29 08:07:23.744416 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 252/521] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:07:23 2022] GET /compute/v2.1/servers/c6c089a8-9bde-42b2-aa4e-014dcc9a6a30 => generated 1304 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:07:23.986902 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-8f062e4d-bb35-4a8b-8c68-d5ab0f70ea4d tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:07:23.987521 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-8f062e4d-bb35-4a8b-8c68-d5ab0f70ea4d tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] [instance: ca231b38-fd3e-43ba-9cba-1de10a1ffeec] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:07:23.994426 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-8f062e4d-bb35-4a8b-8c68-d5ab0f70ea4d tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:07:23.994882 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-8f062e4d-bb35-4a8b-8c68-d5ab0f70ea4d tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:07:23.995677 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-8f062e4d-bb35-4a8b-8c68-d5ab0f70ea4d tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:07:23.996125 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-8f062e4d-bb35-4a8b-8c68-d5ab0f70ea4d tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:07:24.135332 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-8f062e4d-bb35-4a8b-8c68-d5ab0f70ea4d tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4af4eedee24897be2e702ef51873b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab693125979f4bb7b7b3c94061610fe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:07:24.149588 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-8f062e4d-bb35-4a8b-8c68-d5ab0f70ea4d tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] 10.222.0.43 "GET /compute/v2.1/servers/ca231b38-fd3e-43ba-9cba-1de10a1ffeec" status: 200 len: 1734 microversion: 2.1 time: 0.167498 Jun 29 08:07:24.150333 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 270/522] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:07:23 2022] GET /compute/v2.1/servers/ca231b38-fd3e-43ba-9cba-1de10a1ffeec => generated 1734 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:07:24.763135 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-3abd71e4-7a47-4491-b7e0-006986d30e26 tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:07:24.763758 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-3abd71e4-7a47-4491-b7e0-006986d30e26 tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] [instance: c6c089a8-9bde-42b2-aa4e-014dcc9a6a30] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:07:24.771341 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-3abd71e4-7a47-4491-b7e0-006986d30e26 tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:07:24.771786 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-3abd71e4-7a47-4491-b7e0-006986d30e26 tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:07:24.772577 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-3abd71e4-7a47-4491-b7e0-006986d30e26 tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:07:24.773032 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-3abd71e4-7a47-4491-b7e0-006986d30e26 tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:07:24.789018 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.wsgi [None req-3abd71e4-7a47-4491-b7e0-006986d30e26 tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] HTTP exception thrown: Instance c6c089a8-9bde-42b2-aa4e-014dcc9a6a30 could not be found. Jun 29 08:07:24.790849 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-3abd71e4-7a47-4491-b7e0-006986d30e26 tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Request method failure captured: Jun 29 08:07:24.790849 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: request: GET /compute/v2.1/servers/c6c089a8-9bde-42b2-aa4e-014dcc9a6a30 HTTP/1.1 Jun 29 08:07:24.790849 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: Accept: application/json Jun 29 08:07:24.790849 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: Accept-Encoding: identity Jun 29 08:07:24.790849 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: Connection: close Jun 29 08:07:24.790849 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: Content-Length: 0 Jun 29 08:07:24.790849 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: Content-Type: application/json Jun 29 08:07:24.790849 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: Host: 10.222.0.43 Jun 29 08:07:24.790849 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: Openstack-System-Scope: None Jun 29 08:07:24.790849 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: User-Agent: python-urllib3/1.26.9 Jun 29 08:07:24.790849 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Auth-Token: gAAAAABivAePHe033RxOxYZwgeJ7-BqP41F5_iJwgyFr5cODuXFlqHSuk63eqBhgfBMhgDpfeg0QF5vU7SDawMJR3AbVzJ1bJvjCKuKfPZgYgjxX6jM0Vfe5rHPfvhzcr5moyuGEW3EsPOY6xmig7ORp-rZVwV4AL3UW0rT1UTpl72auJwRns4s Jun 29 08:07:24.790849 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Domain-Id: None Jun 29 08:07:24.790849 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Domain-Name: None Jun 29 08:07:24.790849 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Identity-Status: Confirmed Jun 29 08:07:24.790849 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Is-Admin-Project: True Jun 29 08:07:24.790849 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Project-Domain-Id: default Jun 29 08:07:24.790849 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Project-Domain-Name: Default Jun 29 08:07:24.790849 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Project-Id: 7bdadf97d44048c3bec51c0ae58ee4a6 Jun 29 08:07:24.790849 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Project-Name: tempest-VolumesSnapshotTestJSON-591127580 Jun 29 08:07:24.790849 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Role: member,reader Jun 29 08:07:24.790849 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Roles: member,reader Jun 29 08:07:24.792432 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/7bdadf97d44048c3bec51c0ae58ee4a6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_7bdadf97d44048c3bec51c0ae58ee4a6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/7bdadf97d44048c3bec51c0ae58ee4a6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/7bdadf97d44048c3bec51c0ae58ee4a6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Jun 29 08:07:24.792432 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Tenant: tempest-VolumesSnapshotTestJSON-591127580 Jun 29 08:07:24.792432 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Tenant-Id: 7bdadf97d44048c3bec51c0ae58ee4a6 Jun 29 08:07:24.792432 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-591127580 Jun 29 08:07:24.792432 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-User: tempest-VolumesSnapshotTestJSON-591127580-project Jun 29 08:07:24.792432 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-User-Domain-Id: default Jun 29 08:07:24.792432 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-User-Domain-Name: Default Jun 29 08:07:24.792432 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-User-Id: c1feaba97f594ffda9dd2962bebdc082 Jun 29 08:07:24.792432 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-User-Name: tempest-VolumesSnapshotTestJSON-591127580-project Jun 29 08:07:24.792432 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: method: > Jun 29 08:07:24.792432 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: exception: Instance c6c089a8-9bde-42b2-aa4e-014dcc9a6a30 could not be found. Jun 29 08:07:24.792432 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: action_args: {'id': 'c6c089a8-9bde-42b2-aa4e-014dcc9a6a30'} Jun 29 08:07:24.793362 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 08:07:24.793362 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:07:24.793362 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 29 08:07:24.793362 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 29 08:07:24.793362 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 29 08:07:24.793362 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 29 08:07:24.793362 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 29 08:07:24.793362 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 29 08:07:24.793362 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 29 08:07:24.793362 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 29 08:07:24.793362 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c6c089a8-9bde-42b2-aa4e-014dcc9a6a30 could not be found. Jun 29 08:07:24.793362 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 29 08:07:24.793362 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 08:07:24.793362 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 29 08:07:24.793362 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:07:24.793362 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 08:07:24.793362 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 08:07:24.793362 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 08:07:24.793362 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 08:07:24.793362 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 08:07:24.794587 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 08:07:24.794587 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 29 08:07:24.794587 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 29 08:07:24.794587 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 29 08:07:24.794587 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 29 08:07:24.794587 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 29 08:07:24.794587 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 29 08:07:24.794587 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c6c089a8-9bde-42b2-aa4e-014dcc9a6a30 could not be found. Jun 29 08:07:24.794587 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 29 08:07:24.794587 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 08:07:24.794587 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 29 08:07:24.794587 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:07:24.794587 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 08:07:24.794587 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 08:07:24.794587 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 08:07:24.794587 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 08:07:24.794587 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c6c089a8-9bde-42b2-aa4e-014dcc9a6a30 could not be found. Jun 29 08:07:24.794587 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 29 08:07:24.795702 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-3abd71e4-7a47-4491-b7e0-006986d30e26 tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] Returning 404 to user: Instance c6c089a8-9bde-42b2-aa4e-014dcc9a6a30 could not be found. {{(pid=117890) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 08:07:24.795702 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-3abd71e4-7a47-4491-b7e0-006986d30e26 tempest-VolumesSnapshotTestJSON-591127580 tempest-VolumesSnapshotTestJSON-591127580-project] 10.222.0.43 "GET /compute/v2.1/servers/c6c089a8-9bde-42b2-aa4e-014dcc9a6a30" status: 404 len: 111 microversion: 2.1 time: 0.033470 Jun 29 08:07:24.795702 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 253/523] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:07:24 2022] GET /compute/v2.1/servers/c6c089a8-9bde-42b2-aa4e-014dcc9a6a30 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 29 08:07:25.073810 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-09d281d8-5008-4212-b10c-5d981e6e88a7 tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:07:25.075110 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-09d281d8-5008-4212-b10c-5d981e6e88a7 tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] [instance: 4a523b7d-76fc-4f57-9bfe-c9c2b4b0b8c8] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:07:25.084737 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-09d281d8-5008-4212-b10c-5d981e6e88a7 tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:07:25.086061 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-09d281d8-5008-4212-b10c-5d981e6e88a7 tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:07:25.087224 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-09d281d8-5008-4212-b10c-5d981e6e88a7 tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:07:25.087764 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-09d281d8-5008-4212-b10c-5d981e6e88a7 tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:07:25.166027 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-09d281d8-5008-4212-b10c-5d981e6e88a7 tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] 10.222.0.43 "POST /compute/v2.1/servers/4a523b7d-76fc-4f57-9bfe-c9c2b4b0b8c8/action" status: 202 len: 0 microversion: 2.1 time: 0.096959 Jun 29 08:07:25.166744 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 271/524] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Jun 29 08:07:25 2022] POST /compute/v2.1/servers/4a523b7d-76fc-4f57-9bfe-c9c2b4b0b8c8/action => generated 0 bytes in 99 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 29 08:07:25.167922 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-ad0e3863-2b03-4e58-9669-e991524efc98 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:07:25.168542 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-ad0e3863-2b03-4e58-9669-e991524efc98 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] [instance: ca231b38-fd3e-43ba-9cba-1de10a1ffeec] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:07:25.176766 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-ad0e3863-2b03-4e58-9669-e991524efc98 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:07:25.177160 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-ec379f1c-9f33-4797-9e8d-85b0b8b2978b tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:07:25.177306 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-ad0e3863-2b03-4e58-9669-e991524efc98 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:07:25.177991 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-ec379f1c-9f33-4797-9e8d-85b0b8b2978b tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] [instance: 4a523b7d-76fc-4f57-9bfe-c9c2b4b0b8c8] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:07:25.178110 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-ad0e3863-2b03-4e58-9669-e991524efc98 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:07:25.178493 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-ad0e3863-2b03-4e58-9669-e991524efc98 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:07:25.184701 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ec379f1c-9f33-4797-9e8d-85b0b8b2978b tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:07:25.185983 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ec379f1c-9f33-4797-9e8d-85b0b8b2978b tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:07:25.189180 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ec379f1c-9f33-4797-9e8d-85b0b8b2978b tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:07:25.189180 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ec379f1c-9f33-4797-9e8d-85b0b8b2978b tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:07:25.349897 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-ec379f1c-9f33-4797-9e8d-85b0b8b2978b tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6663857e60ca4440a9a620007be4c2c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7afb1bdb06042f4b983631745f32e19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:07:25.358530 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-ec379f1c-9f33-4797-9e8d-85b0b8b2978b tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] 10.222.0.43 "GET /compute/v2.1/servers/4a523b7d-76fc-4f57-9bfe-c9c2b4b0b8c8" status: 200 len: 1749 microversion: 2.1 time: 0.187464 Jun 29 08:07:25.359088 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 272/525] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:07:25 2022] GET /compute/v2.1/servers/4a523b7d-76fc-4f57-9bfe-c9c2b4b0b8c8 => generated 1749 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 08:07:25.391838 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-ad0e3863-2b03-4e58-9669-e991524efc98 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4af4eedee24897be2e702ef51873b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab693125979f4bb7b7b3c94061610fe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:07:25.399932 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-ad0e3863-2b03-4e58-9669-e991524efc98 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] 10.222.0.43 "GET /compute/v2.1/servers/ca231b38-fd3e-43ba-9cba-1de10a1ffeec" status: 200 len: 1734 microversion: 2.1 time: 0.236256 Jun 29 08:07:25.400511 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 254/526] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:07:25 2022] GET /compute/v2.1/servers/ca231b38-fd3e-43ba-9cba-1de10a1ffeec => generated 1734 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 08:07:26.376829 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-52998724-0da5-4bf2-b208-dc05cc758667 tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:07:26.377397 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-52998724-0da5-4bf2-b208-dc05cc758667 tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] [instance: 4a523b7d-76fc-4f57-9bfe-c9c2b4b0b8c8] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:07:26.384014 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-52998724-0da5-4bf2-b208-dc05cc758667 tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:07:26.384688 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-52998724-0da5-4bf2-b208-dc05cc758667 tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:07:26.385275 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-52998724-0da5-4bf2-b208-dc05cc758667 tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:07:26.385742 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-52998724-0da5-4bf2-b208-dc05cc758667 tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:07:26.417500 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-db600f9d-8046-4f97-94b6-7dcd85deafcf tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:07:26.418102 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-db600f9d-8046-4f97-94b6-7dcd85deafcf tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] [instance: ca231b38-fd3e-43ba-9cba-1de10a1ffeec] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:07:26.426158 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-db600f9d-8046-4f97-94b6-7dcd85deafcf tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:07:26.426601 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-db600f9d-8046-4f97-94b6-7dcd85deafcf tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:07:26.427374 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-db600f9d-8046-4f97-94b6-7dcd85deafcf tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:07:26.427806 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-db600f9d-8046-4f97-94b6-7dcd85deafcf tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:07:26.539615 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-52998724-0da5-4bf2-b208-dc05cc758667 tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6663857e60ca4440a9a620007be4c2c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7afb1bdb06042f4b983631745f32e19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:07:26.548326 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-52998724-0da5-4bf2-b208-dc05cc758667 tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] 10.222.0.43 "GET /compute/v2.1/servers/4a523b7d-76fc-4f57-9bfe-c9c2b4b0b8c8" status: 200 len: 1754 microversion: 2.1 time: 0.175943 Jun 29 08:07:26.548911 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 273/527] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:07:26 2022] GET /compute/v2.1/servers/4a523b7d-76fc-4f57-9bfe-c9c2b4b0b8c8 => generated 1754 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:07:26.565852 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-db600f9d-8046-4f97-94b6-7dcd85deafcf tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4af4eedee24897be2e702ef51873b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab693125979f4bb7b7b3c94061610fe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:07:26.573780 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-db600f9d-8046-4f97-94b6-7dcd85deafcf tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] 10.222.0.43 "GET /compute/v2.1/servers/ca231b38-fd3e-43ba-9cba-1de10a1ffeec" status: 200 len: 1734 microversion: 2.1 time: 0.160060 Jun 29 08:07:26.574341 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 255/528] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:07:26 2022] GET /compute/v2.1/servers/ca231b38-fd3e-43ba-9cba-1de10a1ffeec => generated 1734 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 08:07:27.566446 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-8ccbdae4-72a6-4f93-acc9-945e24397717 tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:07:27.567057 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-8ccbdae4-72a6-4f93-acc9-945e24397717 tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] [instance: 4a523b7d-76fc-4f57-9bfe-c9c2b4b0b8c8] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:07:27.573723 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-8ccbdae4-72a6-4f93-acc9-945e24397717 tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:07:27.574173 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-8ccbdae4-72a6-4f93-acc9-945e24397717 tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:07:27.574939 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-8ccbdae4-72a6-4f93-acc9-945e24397717 tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:07:27.575377 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-8ccbdae4-72a6-4f93-acc9-945e24397717 tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:07:27.590364 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-145659e1-f9ca-4b8b-b46d-8e5543a2c8c1 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:07:27.590887 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-145659e1-f9ca-4b8b-b46d-8e5543a2c8c1 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] [instance: ca231b38-fd3e-43ba-9cba-1de10a1ffeec] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:07:27.598162 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-145659e1-f9ca-4b8b-b46d-8e5543a2c8c1 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:07:27.598618 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-145659e1-f9ca-4b8b-b46d-8e5543a2c8c1 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:07:27.599373 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-145659e1-f9ca-4b8b-b46d-8e5543a2c8c1 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:07:27.599802 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-145659e1-f9ca-4b8b-b46d-8e5543a2c8c1 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:07:27.721795 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-8ccbdae4-72a6-4f93-acc9-945e24397717 tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6663857e60ca4440a9a620007be4c2c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7afb1bdb06042f4b983631745f32e19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:07:27.731088 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-8ccbdae4-72a6-4f93-acc9-945e24397717 tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] 10.222.0.43 "GET /compute/v2.1/servers/4a523b7d-76fc-4f57-9bfe-c9c2b4b0b8c8" status: 200 len: 1754 microversion: 2.1 time: 0.169185 Jun 29 08:07:27.731403 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-145659e1-f9ca-4b8b-b46d-8e5543a2c8c1 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4af4eedee24897be2e702ef51873b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab693125979f4bb7b7b3c94061610fe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:07:27.731660 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 274/529] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:07:27 2022] GET /compute/v2.1/servers/4a523b7d-76fc-4f57-9bfe-c9c2b4b0b8c8 => generated 1754 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:07:27.740762 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-145659e1-f9ca-4b8b-b46d-8e5543a2c8c1 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] 10.222.0.43 "GET /compute/v2.1/servers/ca231b38-fd3e-43ba-9cba-1de10a1ffeec" status: 200 len: 1734 microversion: 2.1 time: 0.154408 Jun 29 08:07:27.741363 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 256/530] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:07:27 2022] GET /compute/v2.1/servers/ca231b38-fd3e-43ba-9cba-1de10a1ffeec => generated 1734 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 08:07:28.749587 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-9821adfe-8d39-4d0b-abf7-35ec9fd86347 tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:07:28.750166 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-9821adfe-8d39-4d0b-abf7-35ec9fd86347 tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] [instance: 4a523b7d-76fc-4f57-9bfe-c9c2b4b0b8c8] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:07:28.757144 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-9821adfe-8d39-4d0b-abf7-35ec9fd86347 tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:07:28.757586 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-9821adfe-8d39-4d0b-abf7-35ec9fd86347 tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:07:28.758234 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-ac712b84-005a-4222-8880-5b67b5aa2623 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:07:28.758681 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-9821adfe-8d39-4d0b-abf7-35ec9fd86347 tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:07:28.758805 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-9821adfe-8d39-4d0b-abf7-35ec9fd86347 tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:07:28.758902 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-ac712b84-005a-4222-8880-5b67b5aa2623 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] [instance: ca231b38-fd3e-43ba-9cba-1de10a1ffeec] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:07:28.771117 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-ac712b84-005a-4222-8880-5b67b5aa2623 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:07:28.771563 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-ac712b84-005a-4222-8880-5b67b5aa2623 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:07:28.772351 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-ac712b84-005a-4222-8880-5b67b5aa2623 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:07:28.772790 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-ac712b84-005a-4222-8880-5b67b5aa2623 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:07:28.921547 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-9821adfe-8d39-4d0b-abf7-35ec9fd86347 tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6663857e60ca4440a9a620007be4c2c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7afb1bdb06042f4b983631745f32e19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:07:28.932128 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-ac712b84-005a-4222-8880-5b67b5aa2623 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4af4eedee24897be2e702ef51873b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab693125979f4bb7b7b3c94061610fe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:07:28.934146 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-9821adfe-8d39-4d0b-abf7-35ec9fd86347 tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] 10.222.0.43 "GET /compute/v2.1/servers/4a523b7d-76fc-4f57-9bfe-c9c2b4b0b8c8" status: 200 len: 1754 microversion: 2.1 time: 0.188501 Jun 29 08:07:28.935570 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 275/531] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:07:28 2022] GET /compute/v2.1/servers/4a523b7d-76fc-4f57-9bfe-c9c2b4b0b8c8 => generated 1754 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:07:28.945641 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-ac712b84-005a-4222-8880-5b67b5aa2623 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] 10.222.0.43 "GET /compute/v2.1/servers/ca231b38-fd3e-43ba-9cba-1de10a1ffeec" status: 200 len: 1734 microversion: 2.1 time: 0.190727 Jun 29 08:07:28.946651 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 257/532] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:07:28 2022] GET /compute/v2.1/servers/ca231b38-fd3e-43ba-9cba-1de10a1ffeec => generated 1734 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:07:29.959805 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-fc95f088-f40a-41d8-bd3f-7b393b312f2c tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:07:29.960373 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-fc95f088-f40a-41d8-bd3f-7b393b312f2c tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] [instance: 4a523b7d-76fc-4f57-9bfe-c9c2b4b0b8c8] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:07:29.964817 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-6199c746-0b40-4d14-a1ec-076b7c621aa7 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:07:29.965469 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-6199c746-0b40-4d14-a1ec-076b7c621aa7 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] [instance: ca231b38-fd3e-43ba-9cba-1de10a1ffeec] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:07:29.967293 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-fc95f088-f40a-41d8-bd3f-7b393b312f2c tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:07:29.967740 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-fc95f088-f40a-41d8-bd3f-7b393b312f2c tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:07:29.968502 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-fc95f088-f40a-41d8-bd3f-7b393b312f2c tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:07:29.969054 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-fc95f088-f40a-41d8-bd3f-7b393b312f2c tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:07:29.972559 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-6199c746-0b40-4d14-a1ec-076b7c621aa7 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:07:29.973039 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-6199c746-0b40-4d14-a1ec-076b7c621aa7 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:07:29.973822 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-6199c746-0b40-4d14-a1ec-076b7c621aa7 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:07:29.974265 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-6199c746-0b40-4d14-a1ec-076b7c621aa7 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:07:29.988914 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:07:30.116733 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-6199c746-0b40-4d14-a1ec-076b7c621aa7 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4af4eedee24897be2e702ef51873b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab693125979f4bb7b7b3c94061610fe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:07:30.124807 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-6199c746-0b40-4d14-a1ec-076b7c621aa7 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] 10.222.0.43 "GET /compute/v2.1/servers/ca231b38-fd3e-43ba-9cba-1de10a1ffeec" status: 200 len: 1734 microversion: 2.1 time: 0.163704 Jun 29 08:07:30.125656 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 258/533] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:07:29 2022] GET /compute/v2.1/servers/ca231b38-fd3e-43ba-9cba-1de10a1ffeec => generated 1734 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 08:07:30.132247 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-fc95f088-f40a-41d8-bd3f-7b393b312f2c tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6663857e60ca4440a9a620007be4c2c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7afb1bdb06042f4b983631745f32e19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:07:30.140172 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-fc95f088-f40a-41d8-bd3f-7b393b312f2c tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] 10.222.0.43 "GET /compute/v2.1/servers/4a523b7d-76fc-4f57-9bfe-c9c2b4b0b8c8" status: 200 len: 1754 microversion: 2.1 time: 0.184322 Jun 29 08:07:30.140771 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 276/534] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:07:29 2022] GET /compute/v2.1/servers/4a523b7d-76fc-4f57-9bfe-c9c2b4b0b8c8 => generated 1754 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:07:31.142837 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-5aa0ceb7-7bb9-4f8e-99e9-c115b6b803b5 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:07:31.143476 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-5aa0ceb7-7bb9-4f8e-99e9-c115b6b803b5 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] [instance: ca231b38-fd3e-43ba-9cba-1de10a1ffeec] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:07:31.149994 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-5aa0ceb7-7bb9-4f8e-99e9-c115b6b803b5 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:07:31.150442 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-5aa0ceb7-7bb9-4f8e-99e9-c115b6b803b5 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:07:31.151695 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-5aa0ceb7-7bb9-4f8e-99e9-c115b6b803b5 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:07:31.151695 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-5aa0ceb7-7bb9-4f8e-99e9-c115b6b803b5 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:07:31.156857 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-101c4a7f-1cf1-4330-87a9-178e1d7a2b3b tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:07:31.157595 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-101c4a7f-1cf1-4330-87a9-178e1d7a2b3b tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] [instance: 4a523b7d-76fc-4f57-9bfe-c9c2b4b0b8c8] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:07:31.164216 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-101c4a7f-1cf1-4330-87a9-178e1d7a2b3b tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:07:31.164675 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-101c4a7f-1cf1-4330-87a9-178e1d7a2b3b tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:07:31.165485 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-101c4a7f-1cf1-4330-87a9-178e1d7a2b3b tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:07:31.165928 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-101c4a7f-1cf1-4330-87a9-178e1d7a2b3b tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:07:31.315663 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-5aa0ceb7-7bb9-4f8e-99e9-c115b6b803b5 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4af4eedee24897be2e702ef51873b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab693125979f4bb7b7b3c94061610fe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:07:31.323568 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-5aa0ceb7-7bb9-4f8e-99e9-c115b6b803b5 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] 10.222.0.43 "GET /compute/v2.1/servers/ca231b38-fd3e-43ba-9cba-1de10a1ffeec" status: 200 len: 1734 microversion: 2.1 time: 0.185168 Jun 29 08:07:31.324131 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 259/535] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:07:31 2022] GET /compute/v2.1/servers/ca231b38-fd3e-43ba-9cba-1de10a1ffeec => generated 1734 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:07:31.327587 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-101c4a7f-1cf1-4330-87a9-178e1d7a2b3b tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6663857e60ca4440a9a620007be4c2c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7afb1bdb06042f4b983631745f32e19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:07:31.335627 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-101c4a7f-1cf1-4330-87a9-178e1d7a2b3b tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] 10.222.0.43 "GET /compute/v2.1/servers/4a523b7d-76fc-4f57-9bfe-c9c2b4b0b8c8" status: 200 len: 1754 microversion: 2.1 time: 0.182761 Jun 29 08:07:31.336186 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 277/536] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:07:31 2022] GET /compute/v2.1/servers/4a523b7d-76fc-4f57-9bfe-c9c2b4b0b8c8 => generated 1754 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 08:07:32.341389 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-30d78513-db50-4199-bb06-8b3a81e7924a tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:07:32.342043 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-30d78513-db50-4199-bb06-8b3a81e7924a tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] [instance: ca231b38-fd3e-43ba-9cba-1de10a1ffeec] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:07:32.349235 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-30d78513-db50-4199-bb06-8b3a81e7924a tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:07:32.349692 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-30d78513-db50-4199-bb06-8b3a81e7924a tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:07:32.350522 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-30d78513-db50-4199-bb06-8b3a81e7924a tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:07:32.350941 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-30d78513-db50-4199-bb06-8b3a81e7924a tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:07:32.352155 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-f69d85d5-22e5-48b9-9f37-98e65056a228 tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:07:32.352778 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-f69d85d5-22e5-48b9-9f37-98e65056a228 tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] [instance: 4a523b7d-76fc-4f57-9bfe-c9c2b4b0b8c8] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:07:32.359886 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-f69d85d5-22e5-48b9-9f37-98e65056a228 tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:07:32.361384 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-f69d85d5-22e5-48b9-9f37-98e65056a228 tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:07:32.362114 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-f69d85d5-22e5-48b9-9f37-98e65056a228 tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:07:32.362564 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-f69d85d5-22e5-48b9-9f37-98e65056a228 tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:07:32.497728 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-30d78513-db50-4199-bb06-8b3a81e7924a tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4af4eedee24897be2e702ef51873b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab693125979f4bb7b7b3c94061610fe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:07:32.506160 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-30d78513-db50-4199-bb06-8b3a81e7924a tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] 10.222.0.43 "GET /compute/v2.1/servers/ca231b38-fd3e-43ba-9cba-1de10a1ffeec" status: 200 len: 1734 microversion: 2.1 time: 0.168697 Jun 29 08:07:32.506755 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 260/537] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:07:32 2022] GET /compute/v2.1/servers/ca231b38-fd3e-43ba-9cba-1de10a1ffeec => generated 1734 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:07:32.522254 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-f69d85d5-22e5-48b9-9f37-98e65056a228 tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6663857e60ca4440a9a620007be4c2c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7afb1bdb06042f4b983631745f32e19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:07:32.530607 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-f69d85d5-22e5-48b9-9f37-98e65056a228 tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] 10.222.0.43 "GET /compute/v2.1/servers/4a523b7d-76fc-4f57-9bfe-c9c2b4b0b8c8" status: 200 len: 1754 microversion: 2.1 time: 0.182276 Jun 29 08:07:32.531189 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 278/538] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:07:32 2022] GET /compute/v2.1/servers/4a523b7d-76fc-4f57-9bfe-c9c2b4b0b8c8 => generated 1754 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:07:33.522356 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-9e7da53c-f38d-4778-a9f0-cc2f9a42937b tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:07:33.522962 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-9e7da53c-f38d-4778-a9f0-cc2f9a42937b tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] [instance: ca231b38-fd3e-43ba-9cba-1de10a1ffeec] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:07:33.529617 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-9e7da53c-f38d-4778-a9f0-cc2f9a42937b tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:07:33.530063 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-9e7da53c-f38d-4778-a9f0-cc2f9a42937b tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:07:33.530838 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-9e7da53c-f38d-4778-a9f0-cc2f9a42937b tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:07:33.531330 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-9e7da53c-f38d-4778-a9f0-cc2f9a42937b tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:07:33.548920 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-f33f2387-afe2-4b25-8fb4-2a3e86c3014c tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:07:33.549572 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-f33f2387-afe2-4b25-8fb4-2a3e86c3014c tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] [instance: 4a523b7d-76fc-4f57-9bfe-c9c2b4b0b8c8] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:07:33.556196 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-f33f2387-afe2-4b25-8fb4-2a3e86c3014c tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:07:33.556643 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-f33f2387-afe2-4b25-8fb4-2a3e86c3014c tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:07:33.557460 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-f33f2387-afe2-4b25-8fb4-2a3e86c3014c tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:07:33.557903 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-f33f2387-afe2-4b25-8fb4-2a3e86c3014c tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:07:33.677715 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-9e7da53c-f38d-4778-a9f0-cc2f9a42937b tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4af4eedee24897be2e702ef51873b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab693125979f4bb7b7b3c94061610fe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:07:33.680232 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG dbcounter [-] [117890] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:07:33.688668 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-9e7da53c-f38d-4778-a9f0-cc2f9a42937b tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] 10.222.0.43 "GET /compute/v2.1/servers/ca231b38-fd3e-43ba-9cba-1de10a1ffeec" status: 200 len: 1734 microversion: 2.1 time: 0.169357 Jun 29 08:07:33.689421 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 261/539] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:07:33 2022] GET /compute/v2.1/servers/ca231b38-fd3e-43ba-9cba-1de10a1ffeec => generated 1734 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:07:33.734504 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-f33f2387-afe2-4b25-8fb4-2a3e86c3014c tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6663857e60ca4440a9a620007be4c2c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7afb1bdb06042f4b983631745f32e19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:07:33.743112 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-f33f2387-afe2-4b25-8fb4-2a3e86c3014c tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] 10.222.0.43 "GET /compute/v2.1/servers/4a523b7d-76fc-4f57-9bfe-c9c2b4b0b8c8" status: 200 len: 1754 microversion: 2.1 time: 0.198326 Jun 29 08:07:33.743695 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 279/540] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:07:33 2022] GET /compute/v2.1/servers/4a523b7d-76fc-4f57-9bfe-c9c2b4b0b8c8 => generated 1754 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 08:07:34.714251 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-1b2fc71c-e122-4480-bd97-880899bcd3b1 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:07:34.714856 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-1b2fc71c-e122-4480-bd97-880899bcd3b1 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] [instance: ca231b38-fd3e-43ba-9cba-1de10a1ffeec] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:07:34.723800 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-1b2fc71c-e122-4480-bd97-880899bcd3b1 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:07:34.724237 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-1b2fc71c-e122-4480-bd97-880899bcd3b1 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:07:34.724965 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-1b2fc71c-e122-4480-bd97-880899bcd3b1 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:07:34.725428 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-1b2fc71c-e122-4480-bd97-880899bcd3b1 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:07:34.760377 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-67d7b197-1c0e-440a-b983-4a28986e9aab tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:07:34.761016 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-67d7b197-1c0e-440a-b983-4a28986e9aab tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] [instance: 4a523b7d-76fc-4f57-9bfe-c9c2b4b0b8c8] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:07:34.768232 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-67d7b197-1c0e-440a-b983-4a28986e9aab tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:07:34.768670 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-67d7b197-1c0e-440a-b983-4a28986e9aab tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:07:34.769509 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-67d7b197-1c0e-440a-b983-4a28986e9aab tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:07:34.769952 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-67d7b197-1c0e-440a-b983-4a28986e9aab tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:07:34.863470 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-1b2fc71c-e122-4480-bd97-880899bcd3b1 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4af4eedee24897be2e702ef51873b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab693125979f4bb7b7b3c94061610fe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:07:34.874369 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-1b2fc71c-e122-4480-bd97-880899bcd3b1 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] 10.222.0.43 "GET /compute/v2.1/servers/ca231b38-fd3e-43ba-9cba-1de10a1ffeec" status: 200 len: 1734 microversion: 2.1 time: 0.163999 Jun 29 08:07:34.874962 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 262/541] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:07:34 2022] GET /compute/v2.1/servers/ca231b38-fd3e-43ba-9cba-1de10a1ffeec => generated 1734 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 08:07:34.927131 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-67d7b197-1c0e-440a-b983-4a28986e9aab tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6663857e60ca4440a9a620007be4c2c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7afb1bdb06042f4b983631745f32e19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:07:34.935112 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-67d7b197-1c0e-440a-b983-4a28986e9aab tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] 10.222.0.43 "GET /compute/v2.1/servers/4a523b7d-76fc-4f57-9bfe-c9c2b4b0b8c8" status: 200 len: 1754 microversion: 2.1 time: 0.178600 Jun 29 08:07:34.935708 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 280/542] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:07:34 2022] GET /compute/v2.1/servers/4a523b7d-76fc-4f57-9bfe-c9c2b4b0b8c8 => generated 1754 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:07:35.893987 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-8307d780-10ea-4e92-9f3c-74aa55306aef tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:07:35.894626 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-8307d780-10ea-4e92-9f3c-74aa55306aef tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] [instance: ca231b38-fd3e-43ba-9cba-1de10a1ffeec] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:07:35.902555 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-8307d780-10ea-4e92-9f3c-74aa55306aef tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:07:35.903000 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-8307d780-10ea-4e92-9f3c-74aa55306aef tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:07:35.903770 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-8307d780-10ea-4e92-9f3c-74aa55306aef tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:07:35.904221 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-8307d780-10ea-4e92-9f3c-74aa55306aef tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:07:35.951888 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-506fbfc2-e033-4fd6-bd87-3825b9090cb4 tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:07:35.952498 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-506fbfc2-e033-4fd6-bd87-3825b9090cb4 tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] [instance: 4a523b7d-76fc-4f57-9bfe-c9c2b4b0b8c8] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:07:35.959620 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-506fbfc2-e033-4fd6-bd87-3825b9090cb4 tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:07:35.960069 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-506fbfc2-e033-4fd6-bd87-3825b9090cb4 tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:07:35.960838 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-506fbfc2-e033-4fd6-bd87-3825b9090cb4 tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:07:35.961307 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-506fbfc2-e033-4fd6-bd87-3825b9090cb4 tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:07:36.042064 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-8307d780-10ea-4e92-9f3c-74aa55306aef tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4af4eedee24897be2e702ef51873b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab693125979f4bb7b7b3c94061610fe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:07:36.051227 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-8307d780-10ea-4e92-9f3c-74aa55306aef tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] 10.222.0.43 "GET /compute/v2.1/servers/ca231b38-fd3e-43ba-9cba-1de10a1ffeec" status: 200 len: 1734 microversion: 2.1 time: 0.161824 Jun 29 08:07:36.051796 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 263/543] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:07:35 2022] GET /compute/v2.1/servers/ca231b38-fd3e-43ba-9cba-1de10a1ffeec => generated 1734 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:07:36.114872 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-506fbfc2-e033-4fd6-bd87-3825b9090cb4 tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6663857e60ca4440a9a620007be4c2c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7afb1bdb06042f4b983631745f32e19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:07:36.122778 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-506fbfc2-e033-4fd6-bd87-3825b9090cb4 tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] 10.222.0.43 "GET /compute/v2.1/servers/4a523b7d-76fc-4f57-9bfe-c9c2b4b0b8c8" status: 200 len: 1754 microversion: 2.1 time: 0.174935 Jun 29 08:07:36.123349 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 281/544] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:07:35 2022] GET /compute/v2.1/servers/4a523b7d-76fc-4f57-9bfe-c9c2b4b0b8c8 => generated 1754 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 08:07:37.076005 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-3d9ba6fd-f618-4d59-8bd1-99e38507cc7c tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:07:37.076595 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-3d9ba6fd-f618-4d59-8bd1-99e38507cc7c tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] [instance: ca231b38-fd3e-43ba-9cba-1de10a1ffeec] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:07:37.083814 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-3d9ba6fd-f618-4d59-8bd1-99e38507cc7c tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:07:37.084261 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-3d9ba6fd-f618-4d59-8bd1-99e38507cc7c tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:07:37.085071 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-3d9ba6fd-f618-4d59-8bd1-99e38507cc7c tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:07:37.085495 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-3d9ba6fd-f618-4d59-8bd1-99e38507cc7c tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:07:37.139804 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-d2e99b93-f541-418f-a954-d35a09a4dfd6 tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:07:37.140431 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-d2e99b93-f541-418f-a954-d35a09a4dfd6 tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] [instance: 4a523b7d-76fc-4f57-9bfe-c9c2b4b0b8c8] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:07:37.147629 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-d2e99b93-f541-418f-a954-d35a09a4dfd6 tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:07:37.148074 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-d2e99b93-f541-418f-a954-d35a09a4dfd6 tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:07:37.148841 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-d2e99b93-f541-418f-a954-d35a09a4dfd6 tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:07:37.149313 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-d2e99b93-f541-418f-a954-d35a09a4dfd6 tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:07:37.221480 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-3d9ba6fd-f618-4d59-8bd1-99e38507cc7c tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4af4eedee24897be2e702ef51873b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab693125979f4bb7b7b3c94061610fe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:07:37.229437 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-3d9ba6fd-f618-4d59-8bd1-99e38507cc7c tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] 10.222.0.43 "GET /compute/v2.1/servers/ca231b38-fd3e-43ba-9cba-1de10a1ffeec" status: 200 len: 1734 microversion: 2.1 time: 0.157429 Jun 29 08:07:37.230013 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 264/545] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:07:37 2022] GET /compute/v2.1/servers/ca231b38-fd3e-43ba-9cba-1de10a1ffeec => generated 1734 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:07:37.296831 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-d2e99b93-f541-418f-a954-d35a09a4dfd6 tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6663857e60ca4440a9a620007be4c2c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7afb1bdb06042f4b983631745f32e19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:07:37.305255 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-d2e99b93-f541-418f-a954-d35a09a4dfd6 tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] 10.222.0.43 "GET /compute/v2.1/servers/4a523b7d-76fc-4f57-9bfe-c9c2b4b0b8c8" status: 200 len: 1754 microversion: 2.1 time: 0.169456 Jun 29 08:07:37.305817 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 282/546] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:07:37 2022] GET /compute/v2.1/servers/4a523b7d-76fc-4f57-9bfe-c9c2b4b0b8c8 => generated 1754 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 08:07:38.249065 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-c8323001-69c2-4a34-88bb-864f04ae3522 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:07:38.250060 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-c8323001-69c2-4a34-88bb-864f04ae3522 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] [instance: ca231b38-fd3e-43ba-9cba-1de10a1ffeec] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:07:38.257087 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-c8323001-69c2-4a34-88bb-864f04ae3522 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:07:38.257087 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-c8323001-69c2-4a34-88bb-864f04ae3522 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:07:38.257087 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-c8323001-69c2-4a34-88bb-864f04ae3522 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:07:38.257087 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-c8323001-69c2-4a34-88bb-864f04ae3522 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:07:38.326011 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-e61375c6-97e2-46b0-877f-03f60d4d2f3e tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:07:38.326638 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-e61375c6-97e2-46b0-877f-03f60d4d2f3e tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] [instance: 4a523b7d-76fc-4f57-9bfe-c9c2b4b0b8c8] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:07:38.334296 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e61375c6-97e2-46b0-877f-03f60d4d2f3e tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:07:38.334819 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e61375c6-97e2-46b0-877f-03f60d4d2f3e tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:07:38.335912 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e61375c6-97e2-46b0-877f-03f60d4d2f3e tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:07:38.336015 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e61375c6-97e2-46b0-877f-03f60d4d2f3e tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:07:38.411564 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-c8323001-69c2-4a34-88bb-864f04ae3522 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4af4eedee24897be2e702ef51873b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab693125979f4bb7b7b3c94061610fe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:07:38.420216 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-c8323001-69c2-4a34-88bb-864f04ae3522 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] 10.222.0.43 "GET /compute/v2.1/servers/ca231b38-fd3e-43ba-9cba-1de10a1ffeec" status: 200 len: 1734 microversion: 2.1 time: 0.176393 Jun 29 08:07:38.421162 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 265/547] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:07:38 2022] GET /compute/v2.1/servers/ca231b38-fd3e-43ba-9cba-1de10a1ffeec => generated 1734 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:07:38.506896 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-e61375c6-97e2-46b0-877f-03f60d4d2f3e tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6663857e60ca4440a9a620007be4c2c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7afb1bdb06042f4b983631745f32e19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:07:38.519836 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-e61375c6-97e2-46b0-877f-03f60d4d2f3e tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] 10.222.0.43 "GET /compute/v2.1/servers/4a523b7d-76fc-4f57-9bfe-c9c2b4b0b8c8" status: 200 len: 1754 microversion: 2.1 time: 0.200006 Jun 29 08:07:38.520443 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 283/548] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:07:38 2022] GET /compute/v2.1/servers/4a523b7d-76fc-4f57-9bfe-c9c2b4b0b8c8 => generated 1754 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 08:07:39.438021 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-53e122ab-a414-4b88-b957-46a8f165b9c4 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:07:39.438764 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-53e122ab-a414-4b88-b957-46a8f165b9c4 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] [instance: ca231b38-fd3e-43ba-9cba-1de10a1ffeec] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:07:39.445338 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-53e122ab-a414-4b88-b957-46a8f165b9c4 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:07:39.445779 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-53e122ab-a414-4b88-b957-46a8f165b9c4 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:07:39.446535 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-53e122ab-a414-4b88-b957-46a8f165b9c4 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:07:39.446966 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-53e122ab-a414-4b88-b957-46a8f165b9c4 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:07:39.537856 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-1292e40c-35eb-460b-b6ea-f46a49d4345e tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:07:39.538470 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-1292e40c-35eb-460b-b6ea-f46a49d4345e tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] [instance: 4a523b7d-76fc-4f57-9bfe-c9c2b4b0b8c8] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:07:39.544873 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-1292e40c-35eb-460b-b6ea-f46a49d4345e tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:07:39.545362 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-1292e40c-35eb-460b-b6ea-f46a49d4345e tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:07:39.546206 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-1292e40c-35eb-460b-b6ea-f46a49d4345e tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:07:39.546648 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-1292e40c-35eb-460b-b6ea-f46a49d4345e tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:07:39.580830 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-53e122ab-a414-4b88-b957-46a8f165b9c4 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4af4eedee24897be2e702ef51873b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab693125979f4bb7b7b3c94061610fe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:07:39.589033 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-53e122ab-a414-4b88-b957-46a8f165b9c4 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] 10.222.0.43 "GET /compute/v2.1/servers/ca231b38-fd3e-43ba-9cba-1de10a1ffeec" status: 200 len: 1734 microversion: 2.1 time: 0.154905 Jun 29 08:07:39.589879 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 266/549] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:07:39 2022] GET /compute/v2.1/servers/ca231b38-fd3e-43ba-9cba-1de10a1ffeec => generated 1734 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:07:39.697681 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-1292e40c-35eb-460b-b6ea-f46a49d4345e tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6663857e60ca4440a9a620007be4c2c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7afb1bdb06042f4b983631745f32e19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:07:39.706231 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-1292e40c-35eb-460b-b6ea-f46a49d4345e tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] 10.222.0.43 "GET /compute/v2.1/servers/4a523b7d-76fc-4f57-9bfe-c9c2b4b0b8c8" status: 200 len: 1757 microversion: 2.1 time: 0.172161 Jun 29 08:07:39.706800 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 284/550] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:07:39 2022] GET /compute/v2.1/servers/4a523b7d-76fc-4f57-9bfe-c9c2b4b0b8c8 => generated 1757 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 08:07:40.607387 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-412ad16c-a464-462f-9b81-a6cd4c08bd0e tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:07:40.607975 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-412ad16c-a464-462f-9b81-a6cd4c08bd0e tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] [instance: ca231b38-fd3e-43ba-9cba-1de10a1ffeec] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:07:40.615733 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-412ad16c-a464-462f-9b81-a6cd4c08bd0e tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:07:40.616175 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-412ad16c-a464-462f-9b81-a6cd4c08bd0e tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:07:40.616946 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-412ad16c-a464-462f-9b81-a6cd4c08bd0e tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:07:40.617406 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-412ad16c-a464-462f-9b81-a6cd4c08bd0e tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:07:40.750089 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-412ad16c-a464-462f-9b81-a6cd4c08bd0e tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4af4eedee24897be2e702ef51873b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab693125979f4bb7b7b3c94061610fe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:07:40.758100 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-412ad16c-a464-462f-9b81-a6cd4c08bd0e tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] 10.222.0.43 "GET /compute/v2.1/servers/ca231b38-fd3e-43ba-9cba-1de10a1ffeec" status: 200 len: 1734 microversion: 2.1 time: 0.154706 Jun 29 08:07:40.758674 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 267/551] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:07:40 2022] GET /compute/v2.1/servers/ca231b38-fd3e-43ba-9cba-1de10a1ffeec => generated 1734 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:07:41.775176 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-73893c06-6547-4ee9-9d98-b1263f562eb2 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:07:41.775780 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-73893c06-6547-4ee9-9d98-b1263f562eb2 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] [instance: ca231b38-fd3e-43ba-9cba-1de10a1ffeec] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:07:41.782320 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-73893c06-6547-4ee9-9d98-b1263f562eb2 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:07:41.782793 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-73893c06-6547-4ee9-9d98-b1263f562eb2 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:07:41.783749 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-73893c06-6547-4ee9-9d98-b1263f562eb2 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:07:41.784186 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-73893c06-6547-4ee9-9d98-b1263f562eb2 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:07:41.914403 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-73893c06-6547-4ee9-9d98-b1263f562eb2 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4af4eedee24897be2e702ef51873b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab693125979f4bb7b7b3c94061610fe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:07:41.922868 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-73893c06-6547-4ee9-9d98-b1263f562eb2 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] 10.222.0.43 "GET /compute/v2.1/servers/ca231b38-fd3e-43ba-9cba-1de10a1ffeec" status: 200 len: 1714 microversion: 2.1 time: 0.151465 Jun 29 08:07:41.923442 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 285/552] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:07:41 2022] GET /compute/v2.1/servers/ca231b38-fd3e-43ba-9cba-1de10a1ffeec => generated 1714 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:07:42.029694 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-58686bad-ba64-400c-89fa-c9b502648a30 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:07:42.030218 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-58686bad-ba64-400c-89fa-c9b502648a30 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] [instance: ca231b38-fd3e-43ba-9cba-1de10a1ffeec] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:07:42.037838 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-58686bad-ba64-400c-89fa-c9b502648a30 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:07:42.038306 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-58686bad-ba64-400c-89fa-c9b502648a30 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:07:42.039056 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-58686bad-ba64-400c-89fa-c9b502648a30 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:07:42.039491 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-58686bad-ba64-400c-89fa-c9b502648a30 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:07:42.122182 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.wsgi [None req-58686bad-ba64-400c-89fa-c9b502648a30 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] HTTP exception thrown: Cannot 'detach_volume' instance ca231b38-fd3e-43ba-9cba-1de10a1ffeec while it is in vm_state rescued Jun 29 08:07:42.123695 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-58686bad-ba64-400c-89fa-c9b502648a30 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Request method failure captured: Jun 29 08:07:42.123695 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: request: DELETE /compute/v2.1/servers/ca231b38-fd3e-43ba-9cba-1de10a1ffeec/os-volume_attachments/1b642988-5e5b-4d1e-ae54-55773584effe HTTP/1.1 Jun 29 08:07:42.123695 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: Accept: application/json Jun 29 08:07:42.123695 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: Accept-Encoding: identity Jun 29 08:07:42.123695 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: Connection: close Jun 29 08:07:42.123695 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: Content-Length: 0 Jun 29 08:07:42.123695 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: Content-Type: application/json Jun 29 08:07:42.123695 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: Host: 10.222.0.43 Jun 29 08:07:42.123695 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: Openstack-System-Scope: None Jun 29 08:07:42.123695 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: User-Agent: python-urllib3/1.26.9 Jun 29 08:07:42.123695 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Auth-Token: gAAAAABivAcrRGv8n-hBTzbO-mvdA9ZuWTSzlFAkKkndDN8FN_iXGvsZd7rjQm_nN6TZnE7JfsJp8_xcKjzwxgIiNSK_dDCsCpCeOaZ_u5KXcRULb_0_OxKetSiSEtrbxD9wcdC3B0H-F_SoNZ4yDrjB8_rwxeM6bFtzhz_78UcZZraaffHkiVk Jun 29 08:07:42.123695 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Domain-Id: None Jun 29 08:07:42.123695 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Domain-Name: None Jun 29 08:07:42.123695 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Identity-Status: Confirmed Jun 29 08:07:42.123695 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Is-Admin-Project: True Jun 29 08:07:42.123695 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Project-Domain-Id: default Jun 29 08:07:42.123695 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Project-Domain-Name: Default Jun 29 08:07:42.123695 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Project-Id: ab693125979f4bb7b7b3c94061610fe2 Jun 29 08:07:42.123695 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-796076534 Jun 29 08:07:42.123695 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Role: member,reader Jun 29 08:07:42.123695 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Roles: member,reader Jun 29 08:07:42.125278 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/ab693125979f4bb7b7b3c94061610fe2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_ab693125979f4bb7b7b3c94061610fe2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/ab693125979f4bb7b7b3c94061610fe2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/ab693125979f4bb7b7b3c94061610fe2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Jun 29 08:07:42.125278 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Tenant: tempest-ServerRescueNegativeTestJSON-796076534 Jun 29 08:07:42.125278 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Tenant-Id: ab693125979f4bb7b7b3c94061610fe2 Jun 29 08:07:42.125278 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-796076534 Jun 29 08:07:42.125278 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-User: tempest-ServerRescueNegativeTestJSON-796076534-project Jun 29 08:07:42.125278 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-User-Domain-Id: default Jun 29 08:07:42.125278 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-User-Domain-Name: Default Jun 29 08:07:42.125278 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-User-Id: 1f4af4eedee24897be2e702ef51873b3 Jun 29 08:07:42.125278 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-User-Name: tempest-ServerRescueNegativeTestJSON-796076534-project Jun 29 08:07:42.125278 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: method: > Jun 29 08:07:42.125278 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: exception: Cannot 'detach_volume' instance ca231b38-fd3e-43ba-9cba-1de10a1ffeec while it is in vm_state rescued Jun 29 08:07:42.126078 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: action_args: {'server_id': 'ca231b38-fd3e-43ba-9cba-1de10a1ffeec', 'id': '1b642988-5e5b-4d1e-ae54-55773584effe'} Jun 29 08:07:42.126078 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 08:07:42.126078 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:07:42.126078 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 29 08:07:42.126078 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 29 08:07:42.126078 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 29 08:07:42.126078 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 29 08:07:42.126078 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 29 08:07:42.126078 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 29 08:07:42.126078 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance ca231b38-fd3e-43ba-9cba-1de10a1ffeec in vm_state rescued. Cannot detach_volume while the instance is in this state. Jun 29 08:07:42.126078 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 29 08:07:42.126078 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 08:07:42.126078 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 29 08:07:42.126078 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:07:42.126078 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 08:07:42.126078 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 08:07:42.126078 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 08:07:42.126078 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 08:07:42.126078 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 08:07:42.126078 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 08:07:42.127525 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jun 29 08:07:42.127525 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 29 08:07:42.127525 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 29 08:07:42.127525 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 29 08:07:42.127525 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance ca231b38-fd3e-43ba-9cba-1de10a1ffeec while it is in vm_state rescued Jun 29 08:07:42.127525 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 29 08:07:42.127525 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 08:07:42.127525 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 29 08:07:42.127525 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:07:42.127525 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 08:07:42.127525 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 08:07:42.127525 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 08:07:42.127525 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 08:07:42.127525 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance ca231b38-fd3e-43ba-9cba-1de10a1ffeec while it is in vm_state rescued Jun 29 08:07:42.127525 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 29 08:07:42.127525 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-58686bad-ba64-400c-89fa-c9b502648a30 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Returning 409 to user: Cannot 'detach_volume' instance ca231b38-fd3e-43ba-9cba-1de10a1ffeec while it is in vm_state rescued {{(pid=117890) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 08:07:42.128705 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-58686bad-ba64-400c-89fa-c9b502648a30 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] 10.222.0.43 "DELETE /compute/v2.1/servers/ca231b38-fd3e-43ba-9cba-1de10a1ffeec/os-volume_attachments/1b642988-5e5b-4d1e-ae54-55773584effe" status: 409 len: 152 microversion: 2.1 time: 0.099384 Jun 29 08:07:42.128705 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 268/553] 10.222.0.43 () {58 vars in 1415 bytes} [Wed Jun 29 08:07:42 2022] DELETE /compute/v2.1/servers/ca231b38-fd3e-43ba-9cba-1de10a1ffeec/os-volume_attachments/1b642988-5e5b-4d1e-ae54-55773584effe => generated 152 bytes in 100 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 29 08:07:42.134556 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-88cc19df-1ade-438d-9809-d28f643527db tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:07:42.135134 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-88cc19df-1ade-438d-9809-d28f643527db tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] [instance: ca231b38-fd3e-43ba-9cba-1de10a1ffeec] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:07:42.141208 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-88cc19df-1ade-438d-9809-d28f643527db tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:07:42.141661 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-88cc19df-1ade-438d-9809-d28f643527db tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:07:42.142440 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-88cc19df-1ade-438d-9809-d28f643527db tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:07:42.142876 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-88cc19df-1ade-438d-9809-d28f643527db tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:07:42.212328 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-88cc19df-1ade-438d-9809-d28f643527db tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] 10.222.0.43 "POST /compute/v2.1/servers/ca231b38-fd3e-43ba-9cba-1de10a1ffeec/action" status: 202 len: 0 microversion: 2.1 time: 0.081415 Jun 29 08:07:42.213044 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 286/554] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Jun 29 08:07:42 2022] POST /compute/v2.1/servers/ca231b38-fd3e-43ba-9cba-1de10a1ffeec/action => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 29 08:07:42.221991 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-8582ad6a-025e-4f0a-8b19-5c2760cedaaf tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:07:42.222874 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-8582ad6a-025e-4f0a-8b19-5c2760cedaaf tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] [instance: ca231b38-fd3e-43ba-9cba-1de10a1ffeec] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:07:42.229668 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-8582ad6a-025e-4f0a-8b19-5c2760cedaaf tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:07:42.230165 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-8582ad6a-025e-4f0a-8b19-5c2760cedaaf tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:07:42.230981 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-8582ad6a-025e-4f0a-8b19-5c2760cedaaf tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:07:42.231425 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-8582ad6a-025e-4f0a-8b19-5c2760cedaaf tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:07:42.466809 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-8582ad6a-025e-4f0a-8b19-5c2760cedaaf tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4af4eedee24897be2e702ef51873b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab693125979f4bb7b7b3c94061610fe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:07:42.475929 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-8582ad6a-025e-4f0a-8b19-5c2760cedaaf tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] 10.222.0.43 "GET /compute/v2.1/servers/ca231b38-fd3e-43ba-9cba-1de10a1ffeec" status: 200 len: 1722 microversion: 2.1 time: 0.258612 Jun 29 08:07:42.476494 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 269/555] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:07:42 2022] GET /compute/v2.1/servers/ca231b38-fd3e-43ba-9cba-1de10a1ffeec => generated 1722 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:07:43.494263 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-8f46f184-9d56-44ef-8600-d3716cb96ae4 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:07:43.494970 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-8f46f184-9d56-44ef-8600-d3716cb96ae4 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] [instance: ca231b38-fd3e-43ba-9cba-1de10a1ffeec] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:07:43.501253 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-8f46f184-9d56-44ef-8600-d3716cb96ae4 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:07:43.502182 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-8f46f184-9d56-44ef-8600-d3716cb96ae4 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:07:43.503593 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-8f46f184-9d56-44ef-8600-d3716cb96ae4 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:07:43.504035 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-8f46f184-9d56-44ef-8600-d3716cb96ae4 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:07:43.647495 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-8f46f184-9d56-44ef-8600-d3716cb96ae4 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4af4eedee24897be2e702ef51873b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab693125979f4bb7b7b3c94061610fe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:07:43.656022 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-8f46f184-9d56-44ef-8600-d3716cb96ae4 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] 10.222.0.43 "GET /compute/v2.1/servers/ca231b38-fd3e-43ba-9cba-1de10a1ffeec" status: 200 len: 1722 microversion: 2.1 time: 0.166332 Jun 29 08:07:43.656601 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 287/556] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:07:43 2022] GET /compute/v2.1/servers/ca231b38-fd3e-43ba-9cba-1de10a1ffeec => generated 1722 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:07:44.673862 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-6eae01dd-70f7-429d-b8eb-0a55a93f79f5 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:07:44.674512 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-6eae01dd-70f7-429d-b8eb-0a55a93f79f5 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] [instance: ca231b38-fd3e-43ba-9cba-1de10a1ffeec] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:07:44.681504 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-6eae01dd-70f7-429d-b8eb-0a55a93f79f5 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:07:44.681856 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-6eae01dd-70f7-429d-b8eb-0a55a93f79f5 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:07:44.682629 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-6eae01dd-70f7-429d-b8eb-0a55a93f79f5 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:07:44.683062 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-6eae01dd-70f7-429d-b8eb-0a55a93f79f5 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:07:44.814290 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-6eae01dd-70f7-429d-b8eb-0a55a93f79f5 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4af4eedee24897be2e702ef51873b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab693125979f4bb7b7b3c94061610fe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:07:44.822488 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-6eae01dd-70f7-429d-b8eb-0a55a93f79f5 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] 10.222.0.43 "GET /compute/v2.1/servers/ca231b38-fd3e-43ba-9cba-1de10a1ffeec" status: 200 len: 1722 microversion: 2.1 time: 0.152859 Jun 29 08:07:44.823046 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 270/557] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:07:44 2022] GET /compute/v2.1/servers/ca231b38-fd3e-43ba-9cba-1de10a1ffeec => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:07:45.839432 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-58d84d24-eb46-41d8-b333-a31adf636c22 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:07:45.840117 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-58d84d24-eb46-41d8-b333-a31adf636c22 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] [instance: ca231b38-fd3e-43ba-9cba-1de10a1ffeec] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:07:45.846956 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-58d84d24-eb46-41d8-b333-a31adf636c22 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:07:45.847413 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-58d84d24-eb46-41d8-b333-a31adf636c22 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:07:45.848318 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-58d84d24-eb46-41d8-b333-a31adf636c22 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:07:45.848636 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-58d84d24-eb46-41d8-b333-a31adf636c22 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:07:45.989269 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-58d84d24-eb46-41d8-b333-a31adf636c22 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4af4eedee24897be2e702ef51873b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab693125979f4bb7b7b3c94061610fe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:07:45.997397 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-58d84d24-eb46-41d8-b333-a31adf636c22 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] 10.222.0.43 "GET /compute/v2.1/servers/ca231b38-fd3e-43ba-9cba-1de10a1ffeec" status: 200 len: 1728 microversion: 2.1 time: 0.161682 Jun 29 08:07:45.997916 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 288/558] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:07:45 2022] GET /compute/v2.1/servers/ca231b38-fd3e-43ba-9cba-1de10a1ffeec => generated 1728 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:07:46.013906 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-2b8ec3a1-362f-4f83-bee0-edff98c9b809 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:07:46.014433 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-2b8ec3a1-362f-4f83-bee0-edff98c9b809 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] [instance: ca231b38-fd3e-43ba-9cba-1de10a1ffeec] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:07:46.021004 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-2b8ec3a1-362f-4f83-bee0-edff98c9b809 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:07:46.021501 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-2b8ec3a1-362f-4f83-bee0-edff98c9b809 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:07:46.022278 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-2b8ec3a1-362f-4f83-bee0-edff98c9b809 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:07:46.022717 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-2b8ec3a1-362f-4f83-bee0-edff98c9b809 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:07:46.107303 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-2b8ec3a1-362f-4f83-bee0-edff98c9b809 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] 10.222.0.43 "GET /compute/v2.1/servers/ca231b38-fd3e-43ba-9cba-1de10a1ffeec/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.097332 Jun 29 08:07:46.107900 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 271/559] 10.222.0.43 () {58 vars in 1274 bytes} [Wed Jun 29 08:07:46 2022] GET /compute/v2.1/servers/ca231b38-fd3e-43ba-9cba-1de10a1ffeec/os-interface => generated 285 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:07:47.215089 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [req-db2651b7-9c06-4bdd-ba75-617d9bf8490d req-608b4e27-ef35-44b6-b087-69129aab5f4f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ca231b38-fd3e-43ba-9cba-1de10a1ffeec", "tag": "5a5ce414-6f70-43b5-a7cc-7340f679070a"}]} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:07:47.219268 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_api:SELECT=53 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:07:47.229372 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-db2651b7-9c06-4bdd-ba75-617d9bf8490d req-608b4e27-ef35-44b6-b087-69129aab5f4f service nova] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:07:47.229821 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-db2651b7-9c06-4bdd-ba75-617d9bf8490d req-608b4e27-ef35-44b6-b087-69129aab5f4f service nova] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:07:47.243895 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.compute.server_external_events [req-db2651b7-9c06-4bdd-ba75-617d9bf8490d req-608b4e27-ef35-44b6-b087-69129aab5f4f service nova] Creating event network-changed:5a5ce414-6f70-43b5-a7cc-7340f679070a for instance ca231b38-fd3e-43ba-9cba-1de10a1ffeec on hv-cinder-76810 Jun 29 08:07:47.249266 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [req-db2651b7-9c06-4bdd-ba75-617d9bf8490d req-608b4e27-ef35-44b6-b087-69129aab5f4f service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038136 Jun 29 08:07:47.249810 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 289/560] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jun 29 08:07:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:07:48.613830 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-6415a5b8-14fa-4cd6-807c-faff9f5e9012 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:07:48.614519 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-6415a5b8-14fa-4cd6-807c-faff9f5e9012 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] [instance: f99567d1-cadf-40c5-b1dc-f86739b2b16c] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:07:48.620825 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG dbcounter [-] [117890] Writing DB stats nova_api:SELECT=58,nova_api:UPDATE=1 {{(pid=117890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:07:48.622800 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-6415a5b8-14fa-4cd6-807c-faff9f5e9012 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:07:48.623242 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-6415a5b8-14fa-4cd6-807c-faff9f5e9012 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:07:48.624066 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-6415a5b8-14fa-4cd6-807c-faff9f5e9012 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:07:48.624500 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-6415a5b8-14fa-4cd6-807c-faff9f5e9012 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:07:48.665213 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-6415a5b8-14fa-4cd6-807c-faff9f5e9012 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] 10.222.0.43 "GET /compute/v2.1/servers/f99567d1-cadf-40c5-b1dc-f86739b2b16c/os-volume_attachments/6eee2879-261b-434a-a378-3814ba506502" status: 200 len: 194 microversion: 2.20 time: 0.055956 Jun 29 08:07:48.665810 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 272/561] 10.222.0.43 () {60 vars in 1453 bytes} [Wed Jun 29 08:07:48 2022] GET /compute/v2.1/servers/f99567d1-cadf-40c5-b1dc-f86739b2b16c/os-volume_attachments/6eee2879-261b-434a-a378-3814ba506502 => generated 194 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 29 08:07:48.740735 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-0ff8c529-6570-47fe-ab43-9dd031d939e4 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:07:48.741342 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-0ff8c529-6570-47fe-ab43-9dd031d939e4 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] [instance: f99567d1-cadf-40c5-b1dc-f86739b2b16c] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:07:48.747525 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-0ff8c529-6570-47fe-ab43-9dd031d939e4 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:07:48.747978 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-0ff8c529-6570-47fe-ab43-9dd031d939e4 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:07:48.748752 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-0ff8c529-6570-47fe-ab43-9dd031d939e4 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:07:48.749222 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-0ff8c529-6570-47fe-ab43-9dd031d939e4 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:07:48.834589 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.objects.instance [None req-0ff8c529-6570-47fe-ab43-9dd031d939e4 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lazy-loading 'services' on Instance uuid f99567d1-cadf-40c5-b1dc-f86739b2b16c {{(pid=117889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 29 08:07:48.911363 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-0ff8c529-6570-47fe-ab43-9dd031d939e4 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] 10.222.0.43 "DELETE /compute/v2.1/servers/f99567d1-cadf-40c5-b1dc-f86739b2b16c/os-volume_attachments/6eee2879-261b-434a-a378-3814ba506502" status: 202 len: 0 microversion: 2.20 time: 0.176210 Jun 29 08:07:48.912490 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 290/562] 10.222.0.43 () {60 vars in 1456 bytes} [Wed Jun 29 08:07:48 2022] DELETE /compute/v2.1/servers/f99567d1-cadf-40c5-b1dc-f86739b2b16c/os-volume_attachments/6eee2879-261b-434a-a378-3814ba506502 => generated 0 bytes in 178 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 29 08:07:48.922600 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-b694485e-50f8-430b-adcf-cf928995ceeb tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:07:48.924740 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-b694485e-50f8-430b-adcf-cf928995ceeb tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] [instance: f99567d1-cadf-40c5-b1dc-f86739b2b16c] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:07:48.931308 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-b694485e-50f8-430b-adcf-cf928995ceeb tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:07:48.931880 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-b694485e-50f8-430b-adcf-cf928995ceeb tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:07:48.932752 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-b694485e-50f8-430b-adcf-cf928995ceeb tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:07:48.933273 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-b694485e-50f8-430b-adcf-cf928995ceeb tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:07:48.968013 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-b694485e-50f8-430b-adcf-cf928995ceeb tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] 10.222.0.43 "GET /compute/v2.1/servers/f99567d1-cadf-40c5-b1dc-f86739b2b16c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051169 Jun 29 08:07:48.968676 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 273/563] 10.222.0.43 () {60 vars in 1342 bytes} [Wed Jun 29 08:07:48 2022] GET /compute/v2.1/servers/f99567d1-cadf-40c5-b1dc-f86739b2b16c/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 29 08:07:49.264540 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [req-4376515c-b6e7-4686-994a-7d85431192d5 req-65352a48-c13f-4542-ab2a-8e14ca2871f3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ca231b38-fd3e-43ba-9cba-1de10a1ffeec", "tag": "5a5ce414-6f70-43b5-a7cc-7340f679070a"}]} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:07:49.273465 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-4376515c-b6e7-4686-994a-7d85431192d5 req-65352a48-c13f-4542-ab2a-8e14ca2871f3 service nova] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:07:49.273906 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-4376515c-b6e7-4686-994a-7d85431192d5 req-65352a48-c13f-4542-ab2a-8e14ca2871f3 service nova] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:07:49.284895 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.compute.server_external_events [req-4376515c-b6e7-4686-994a-7d85431192d5 req-65352a48-c13f-4542-ab2a-8e14ca2871f3 service nova] Creating event network-changed:5a5ce414-6f70-43b5-a7cc-7340f679070a for instance ca231b38-fd3e-43ba-9cba-1de10a1ffeec on hv-cinder-76810 Jun 29 08:07:49.289885 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [req-4376515c-b6e7-4686-994a-7d85431192d5 req-65352a48-c13f-4542-ab2a-8e14ca2871f3 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029580 Jun 29 08:07:49.290465 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 291/564] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jun 29 08:07:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:07:49.980680 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-33a21630-66b1-4776-9b77-45210aa2a234 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:07:49.981872 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-33a21630-66b1-4776-9b77-45210aa2a234 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] [instance: f99567d1-cadf-40c5-b1dc-f86739b2b16c] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:07:49.994313 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-33a21630-66b1-4776-9b77-45210aa2a234 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:07:49.994763 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-33a21630-66b1-4776-9b77-45210aa2a234 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:07:49.995777 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-33a21630-66b1-4776-9b77-45210aa2a234 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:07:49.996211 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-33a21630-66b1-4776-9b77-45210aa2a234 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:07:50.030171 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-33a21630-66b1-4776-9b77-45210aa2a234 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] 10.222.0.43 "GET /compute/v2.1/servers/f99567d1-cadf-40c5-b1dc-f86739b2b16c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053841 Jun 29 08:07:50.035579 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 274/565] 10.222.0.43 () {60 vars in 1342 bytes} [Wed Jun 29 08:07:49 2022] GET /compute/v2.1/servers/f99567d1-cadf-40c5-b1dc-f86739b2b16c/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 29 08:07:51.043879 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-6ad6cff8-3be4-4172-b2e9-7498897cbb8a tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:07:51.045092 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-6ad6cff8-3be4-4172-b2e9-7498897cbb8a tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] [instance: f99567d1-cadf-40c5-b1dc-f86739b2b16c] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:07:51.053052 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-6ad6cff8-3be4-4172-b2e9-7498897cbb8a tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:07:51.053507 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-6ad6cff8-3be4-4172-b2e9-7498897cbb8a tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:07:51.054286 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-6ad6cff8-3be4-4172-b2e9-7498897cbb8a tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:07:51.054743 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-6ad6cff8-3be4-4172-b2e9-7498897cbb8a tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:07:51.081884 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:07:51.088055 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-6ad6cff8-3be4-4172-b2e9-7498897cbb8a tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] 10.222.0.43 "GET /compute/v2.1/servers/f99567d1-cadf-40c5-b1dc-f86739b2b16c/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.049525 Jun 29 08:07:51.088622 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 292/566] 10.222.0.43 () {60 vars in 1342 bytes} [Wed Jun 29 08:07:51 2022] GET /compute/v2.1/servers/f99567d1-cadf-40c5-b1dc-f86739b2b16c/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:07:51.148467 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-f00ed73c-78cf-4def-8d55-5782ff0a5bf4 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:07:51.149009 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-f00ed73c-78cf-4def-8d55-5782ff0a5bf4 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] [instance: f99567d1-cadf-40c5-b1dc-f86739b2b16c] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:07:51.155676 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-f00ed73c-78cf-4def-8d55-5782ff0a5bf4 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:07:51.156125 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-f00ed73c-78cf-4def-8d55-5782ff0a5bf4 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:07:51.156901 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-f00ed73c-78cf-4def-8d55-5782ff0a5bf4 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:07:51.157371 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-f00ed73c-78cf-4def-8d55-5782ff0a5bf4 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:07:51.184487 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-f00ed73c-78cf-4def-8d55-5782ff0a5bf4 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] [instance: f99567d1-cadf-40c5-b1dc-f86739b2b16c] Going to try to terminate instance {{(pid=117890) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 29 08:07:51.259663 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-f00ed73c-78cf-4def-8d55-5782ff0a5bf4 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] 10.222.0.43 "DELETE /compute/v2.1/servers/f99567d1-cadf-40c5-b1dc-f86739b2b16c" status: 204 len: 0 microversion: 2.20 time: 0.114943 Jun 29 08:07:51.260241 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 275/567] 10.222.0.43 () {60 vars in 1279 bytes} [Wed Jun 29 08:07:51 2022] DELETE /compute/v2.1/servers/f99567d1-cadf-40c5-b1dc-f86739b2b16c => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 29 08:07:51.269529 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-aeedbdc2-dff1-4563-96b6-05ef67081ea3 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:07:51.270204 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-aeedbdc2-dff1-4563-96b6-05ef67081ea3 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] [instance: f99567d1-cadf-40c5-b1dc-f86739b2b16c] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:07:51.285238 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-aeedbdc2-dff1-4563-96b6-05ef67081ea3 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:07:51.285685 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-aeedbdc2-dff1-4563-96b6-05ef67081ea3 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:07:51.286452 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-aeedbdc2-dff1-4563-96b6-05ef67081ea3 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:07:51.286885 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-aeedbdc2-dff1-4563-96b6-05ef67081ea3 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:07:51.451650 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-aeedbdc2-dff1-4563-96b6-05ef67081ea3 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:07:51.460857 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-aeedbdc2-dff1-4563-96b6-05ef67081ea3 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:07:51.462400 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-aeedbdc2-dff1-4563-96b6-05ef67081ea3 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:07:51.463586 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-aeedbdc2-dff1-4563-96b6-05ef67081ea3 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] 10.222.0.43 "GET /compute/v2.1/servers/f99567d1-cadf-40c5-b1dc-f86739b2b16c" status: 200 len: 1725 microversion: 2.20 time: 0.198677 Jun 29 08:07:51.464182 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 293/568] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 29 08:07:51 2022] GET /compute/v2.1/servers/f99567d1-cadf-40c5-b1dc-f86739b2b16c => generated 1725 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:07:52.494468 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-0cf61cd6-5734-42c9-b71f-045ecddc494e tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:07:52.495091 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-0cf61cd6-5734-42c9-b71f-045ecddc494e tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] [instance: f99567d1-cadf-40c5-b1dc-f86739b2b16c] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:07:52.501838 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-0cf61cd6-5734-42c9-b71f-045ecddc494e tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:07:52.502282 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-0cf61cd6-5734-42c9-b71f-045ecddc494e tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:07:52.503046 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-0cf61cd6-5734-42c9-b71f-045ecddc494e tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:07:52.503473 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-0cf61cd6-5734-42c9-b71f-045ecddc494e tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:07:52.661989 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-0cf61cd6-5734-42c9-b71f-045ecddc494e tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:07:52.671071 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-0cf61cd6-5734-42c9-b71f-045ecddc494e tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:07:52.672536 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-0cf61cd6-5734-42c9-b71f-045ecddc494e tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:07:52.674574 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-0cf61cd6-5734-42c9-b71f-045ecddc494e tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] 10.222.0.43 "GET /compute/v2.1/servers/f99567d1-cadf-40c5-b1dc-f86739b2b16c" status: 200 len: 1725 microversion: 2.20 time: 0.185463 Jun 29 08:07:52.675138 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 276/569] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 29 08:07:52 2022] GET /compute/v2.1/servers/f99567d1-cadf-40c5-b1dc-f86739b2b16c => generated 1725 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:07:53.693856 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-c94a6439-5c36-45ba-8fe7-66eda9c89d2b tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:07:53.694556 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-c94a6439-5c36-45ba-8fe7-66eda9c89d2b tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] [instance: f99567d1-cadf-40c5-b1dc-f86739b2b16c] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:07:53.702819 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c94a6439-5c36-45ba-8fe7-66eda9c89d2b tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:07:53.703258 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c94a6439-5c36-45ba-8fe7-66eda9c89d2b tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:07:53.704028 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c94a6439-5c36-45ba-8fe7-66eda9c89d2b tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:07:53.705131 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c94a6439-5c36-45ba-8fe7-66eda9c89d2b tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:07:53.841373 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-c94a6439-5c36-45ba-8fe7-66eda9c89d2b tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:07:53.851368 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-c94a6439-5c36-45ba-8fe7-66eda9c89d2b tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:07:53.852913 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-c94a6439-5c36-45ba-8fe7-66eda9c89d2b tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:07:53.854132 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-c94a6439-5c36-45ba-8fe7-66eda9c89d2b tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] 10.222.0.43 "GET /compute/v2.1/servers/f99567d1-cadf-40c5-b1dc-f86739b2b16c" status: 200 len: 1725 microversion: 2.20 time: 0.164889 Jun 29 08:07:53.854707 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 294/570] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 29 08:07:53 2022] GET /compute/v2.1/servers/f99567d1-cadf-40c5-b1dc-f86739b2b16c => generated 1725 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:07:54.873983 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-77cc3dec-6a3e-44a7-a891-e96ece5b2eab tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:07:54.874630 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-77cc3dec-6a3e-44a7-a891-e96ece5b2eab tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] [instance: f99567d1-cadf-40c5-b1dc-f86739b2b16c] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:07:54.882089 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-77cc3dec-6a3e-44a7-a891-e96ece5b2eab tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:07:54.882543 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-77cc3dec-6a3e-44a7-a891-e96ece5b2eab tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:07:54.883317 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-77cc3dec-6a3e-44a7-a891-e96ece5b2eab tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:07:54.883753 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-77cc3dec-6a3e-44a7-a891-e96ece5b2eab tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:07:54.888248 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG dbcounter [-] [117890] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:07:54.909697 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-785c9fe0-1673-4641-b500-2c79ae3526fe tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:07:54.910819 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-785c9fe0-1673-4641-b500-2c79ae3526fe tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] [instance: d5d97f9b-3f4a-4a5e-89e8-98d55412fe71] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:07:54.917676 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-785c9fe0-1673-4641-b500-2c79ae3526fe tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:07:54.918126 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-785c9fe0-1673-4641-b500-2c79ae3526fe tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:07:54.918906 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-785c9fe0-1673-4641-b500-2c79ae3526fe tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:07:54.919339 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-785c9fe0-1673-4641-b500-2c79ae3526fe tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:07:54.959528 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-785c9fe0-1673-4641-b500-2c79ae3526fe tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] 10.222.0.43 "GET /compute/v2.1/servers/d5d97f9b-3f4a-4a5e-89e8-98d55412fe71/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.054411 Jun 29 08:07:54.960280 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 295/571] 10.222.0.43 () {58 vars in 1301 bytes} [Wed Jun 29 08:07:54 2022] GET /compute/v2.1/servers/d5d97f9b-3f4a-4a5e-89e8-98d55412fe71/os-volume_attachments => generated 25 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 29 08:07:55.023489 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-db08b6ee-0786-46e3-9b87-d9693715c49f tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:07:55.023993 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-db08b6ee-0786-46e3-9b87-d9693715c49f tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] [instance: d5d97f9b-3f4a-4a5e-89e8-98d55412fe71] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:07:55.030545 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-db08b6ee-0786-46e3-9b87-d9693715c49f tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:07:55.031571 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-db08b6ee-0786-46e3-9b87-d9693715c49f tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:07:55.031804 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-db08b6ee-0786-46e3-9b87-d9693715c49f tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:07:55.032256 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-db08b6ee-0786-46e3-9b87-d9693715c49f tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:07:55.061079 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-db08b6ee-0786-46e3-9b87-d9693715c49f tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] [instance: d5d97f9b-3f4a-4a5e-89e8-98d55412fe71] Going to try to terminate instance {{(pid=117889) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 29 08:07:55.156367 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-db08b6ee-0786-46e3-9b87-d9693715c49f tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] 10.222.0.43 "DELETE /compute/v2.1/servers/d5d97f9b-3f4a-4a5e-89e8-98d55412fe71" status: 204 len: 0 microversion: 2.1 time: 0.136613 Jun 29 08:07:55.156971 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 296/572] 10.222.0.43 () {58 vars in 1238 bytes} [Wed Jun 29 08:07:55 2022] DELETE /compute/v2.1/servers/d5d97f9b-3f4a-4a5e-89e8-98d55412fe71 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 29 08:07:55.166344 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-34fd47cf-02a3-47bd-a79a-2f3140488051 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:07:55.167058 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-34fd47cf-02a3-47bd-a79a-2f3140488051 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] [instance: d5d97f9b-3f4a-4a5e-89e8-98d55412fe71] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:07:55.174192 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-34fd47cf-02a3-47bd-a79a-2f3140488051 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:07:55.174475 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-34fd47cf-02a3-47bd-a79a-2f3140488051 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:07:55.175662 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-34fd47cf-02a3-47bd-a79a-2f3140488051 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:07:55.176116 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-34fd47cf-02a3-47bd-a79a-2f3140488051 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:07:55.261998 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-77cc3dec-6a3e-44a7-a891-e96ece5b2eab tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:07:55.266412 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-77cc3dec-6a3e-44a7-a891-e96ece5b2eab tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:07:55.268018 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-77cc3dec-6a3e-44a7-a891-e96ece5b2eab tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:07:55.269339 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-77cc3dec-6a3e-44a7-a891-e96ece5b2eab tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] 10.222.0.43 "GET /compute/v2.1/servers/f99567d1-cadf-40c5-b1dc-f86739b2b16c" status: 200 len: 1725 microversion: 2.20 time: 0.399334 Jun 29 08:07:55.269997 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 277/573] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 29 08:07:54 2022] GET /compute/v2.1/servers/f99567d1-cadf-40c5-b1dc-f86739b2b16c => generated 1725 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:07:55.334073 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-34fd47cf-02a3-47bd-a79a-2f3140488051 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c70c44993ab240b1a5231df4c9d550c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e0c37d941434569b3dbd07e22125210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:07:55.341636 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-34fd47cf-02a3-47bd-a79a-2f3140488051 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] 10.222.0.43 "GET /compute/v2.1/servers/d5d97f9b-3f4a-4a5e-89e8-98d55412fe71" status: 200 len: 1673 microversion: 2.1 time: 0.180101 Jun 29 08:07:55.342202 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 297/574] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:07:55 2022] GET /compute/v2.1/servers/d5d97f9b-3f4a-4a5e-89e8-98d55412fe71 => generated 1673 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 08:07:56.290170 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-c715f289-0ab9-437e-854a-c173ad9acec6 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:07:56.290769 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-c715f289-0ab9-437e-854a-c173ad9acec6 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] [instance: f99567d1-cadf-40c5-b1dc-f86739b2b16c] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:07:56.299342 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-c715f289-0ab9-437e-854a-c173ad9acec6 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:07:56.299795 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-c715f289-0ab9-437e-854a-c173ad9acec6 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:07:56.300835 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-c715f289-0ab9-437e-854a-c173ad9acec6 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:07:56.301305 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-c715f289-0ab9-437e-854a-c173ad9acec6 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:07:56.359122 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-4eb8cf7f-eb0d-4180-a6ef-15d815b6d7de tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:07:56.359790 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-4eb8cf7f-eb0d-4180-a6ef-15d815b6d7de tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] [instance: d5d97f9b-3f4a-4a5e-89e8-98d55412fe71] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:07:56.367135 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-4eb8cf7f-eb0d-4180-a6ef-15d815b6d7de tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:07:56.367587 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-4eb8cf7f-eb0d-4180-a6ef-15d815b6d7de tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:07:56.368368 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-4eb8cf7f-eb0d-4180-a6ef-15d815b6d7de tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:07:56.368815 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-4eb8cf7f-eb0d-4180-a6ef-15d815b6d7de tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:07:56.443286 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-c715f289-0ab9-437e-854a-c173ad9acec6 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:07:56.451436 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-c715f289-0ab9-437e-854a-c173ad9acec6 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:07:56.452968 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-c715f289-0ab9-437e-854a-c173ad9acec6 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:07:56.457073 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-c715f289-0ab9-437e-854a-c173ad9acec6 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] 10.222.0.43 "GET /compute/v2.1/servers/f99567d1-cadf-40c5-b1dc-f86739b2b16c" status: 200 len: 1725 microversion: 2.20 time: 0.170723 Jun 29 08:07:56.457657 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 278/575] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 29 08:07:56 2022] GET /compute/v2.1/servers/f99567d1-cadf-40c5-b1dc-f86739b2b16c => generated 1725 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:07:56.507584 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-4eb8cf7f-eb0d-4180-a6ef-15d815b6d7de tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c70c44993ab240b1a5231df4c9d550c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e0c37d941434569b3dbd07e22125210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:07:56.515241 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-4eb8cf7f-eb0d-4180-a6ef-15d815b6d7de tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] 10.222.0.43 "GET /compute/v2.1/servers/d5d97f9b-3f4a-4a5e-89e8-98d55412fe71" status: 200 len: 1673 microversion: 2.1 time: 0.160037 Jun 29 08:07:56.515817 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 298/576] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:07:56 2022] GET /compute/v2.1/servers/d5d97f9b-3f4a-4a5e-89e8-98d55412fe71 => generated 1673 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 08:07:57.475428 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-00750d83-5bfd-4f4c-b089-7d294d8209a6 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:07:57.476027 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-00750d83-5bfd-4f4c-b089-7d294d8209a6 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] [instance: f99567d1-cadf-40c5-b1dc-f86739b2b16c] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:07:57.482876 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-00750d83-5bfd-4f4c-b089-7d294d8209a6 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:07:57.483545 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-00750d83-5bfd-4f4c-b089-7d294d8209a6 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:07:57.484331 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-00750d83-5bfd-4f4c-b089-7d294d8209a6 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:07:57.484864 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-00750d83-5bfd-4f4c-b089-7d294d8209a6 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:07:57.533866 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-4afb2e6c-0346-4f3c-80d6-292aa60bd4c2 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:07:57.534488 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-4afb2e6c-0346-4f3c-80d6-292aa60bd4c2 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] [instance: d5d97f9b-3f4a-4a5e-89e8-98d55412fe71] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:07:57.541168 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-4afb2e6c-0346-4f3c-80d6-292aa60bd4c2 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:07:57.541628 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-4afb2e6c-0346-4f3c-80d6-292aa60bd4c2 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:07:57.542412 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-4afb2e6c-0346-4f3c-80d6-292aa60bd4c2 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:07:57.542856 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-4afb2e6c-0346-4f3c-80d6-292aa60bd4c2 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:07:57.717807 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-4afb2e6c-0346-4f3c-80d6-292aa60bd4c2 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c70c44993ab240b1a5231df4c9d550c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e0c37d941434569b3dbd07e22125210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:07:57.726085 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-4afb2e6c-0346-4f3c-80d6-292aa60bd4c2 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] 10.222.0.43 "GET /compute/v2.1/servers/d5d97f9b-3f4a-4a5e-89e8-98d55412fe71" status: 200 len: 1673 microversion: 2.1 time: 0.196861 Jun 29 08:07:57.726666 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 299/577] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:07:57 2022] GET /compute/v2.1/servers/d5d97f9b-3f4a-4a5e-89e8-98d55412fe71 => generated 1673 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 08:07:57.775547 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-00750d83-5bfd-4f4c-b089-7d294d8209a6 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:07:57.784025 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-00750d83-5bfd-4f4c-b089-7d294d8209a6 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:07:57.785719 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-00750d83-5bfd-4f4c-b089-7d294d8209a6 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:07:57.787137 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-00750d83-5bfd-4f4c-b089-7d294d8209a6 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] 10.222.0.43 "GET /compute/v2.1/servers/f99567d1-cadf-40c5-b1dc-f86739b2b16c" status: 200 len: 1725 microversion: 2.20 time: 0.315812 Jun 29 08:07:57.788276 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 279/578] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 29 08:07:57 2022] GET /compute/v2.1/servers/f99567d1-cadf-40c5-b1dc-f86739b2b16c => generated 1725 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:07:58.825422 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-ed5fcf0d-da1f-48f9-bf3f-43d393194e7a tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:07:58.827647 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-ed5fcf0d-da1f-48f9-bf3f-43d393194e7a tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] [instance: f99567d1-cadf-40c5-b1dc-f86739b2b16c] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:07:58.839602 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-ed5fcf0d-da1f-48f9-bf3f-43d393194e7a tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:07:58.840101 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-ed5fcf0d-da1f-48f9-bf3f-43d393194e7a tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:07:58.843027 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-ed5fcf0d-da1f-48f9-bf3f-43d393194e7a tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:07:58.844665 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-ed5fcf0d-da1f-48f9-bf3f-43d393194e7a tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:07:59.139879 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-71611bbe-220d-459e-9a61-5d098919576b tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:07:59.140738 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-71611bbe-220d-459e-9a61-5d098919576b tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] [instance: d5d97f9b-3f4a-4a5e-89e8-98d55412fe71] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:07:59.154168 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-71611bbe-220d-459e-9a61-5d098919576b tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:07:59.154766 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-71611bbe-220d-459e-9a61-5d098919576b tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:07:59.164638 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-71611bbe-220d-459e-9a61-5d098919576b tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:07:59.165261 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-71611bbe-220d-459e-9a61-5d098919576b tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:07:59.174500 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-ed5fcf0d-da1f-48f9-bf3f-43d393194e7a tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:07:59.199858 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-ed5fcf0d-da1f-48f9-bf3f-43d393194e7a tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:07:59.210945 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-ed5fcf0d-da1f-48f9-bf3f-43d393194e7a tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:07:59.216886 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-ed5fcf0d-da1f-48f9-bf3f-43d393194e7a tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] 10.222.0.43 "GET /compute/v2.1/servers/f99567d1-cadf-40c5-b1dc-f86739b2b16c" status: 200 len: 1657 microversion: 2.20 time: 0.404007 Jun 29 08:07:59.218016 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 280/579] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 29 08:07:58 2022] GET /compute/v2.1/servers/f99567d1-cadf-40c5-b1dc-f86739b2b16c => generated 1657 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 29 08:07:59.236959 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [req-464220f7-6bde-4e5c-85f6-7efd55396fe2 req-41605cf6-c798-4d1c-a0f5-6b68f5172f95 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f99567d1-cadf-40c5-b1dc-f86739b2b16c", "name": "network-vif-deleted", "tag": "dfb8e71b-41e2-4d03-8de7-4f7323f5b53b"}]} {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:07:59.278379 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [req-464220f7-6bde-4e5c-85f6-7efd55396fe2 req-41605cf6-c798-4d1c-a0f5-6b68f5172f95 service nova] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:07:59.282375 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [req-464220f7-6bde-4e5c-85f6-7efd55396fe2 req-41605cf6-c798-4d1c-a0f5-6b68f5172f95 service nova] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:07:59.318249 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.compute.server_external_events [req-464220f7-6bde-4e5c-85f6-7efd55396fe2 req-41605cf6-c798-4d1c-a0f5-6b68f5172f95 service nova] Creating event network-vif-deleted:dfb8e71b-41e2-4d03-8de7-4f7323f5b53b for instance f99567d1-cadf-40c5-b1dc-f86739b2b16c on hv-cinder-76810 Jun 29 08:07:59.345990 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [req-464220f7-6bde-4e5c-85f6-7efd55396fe2 req-41605cf6-c798-4d1c-a0f5-6b68f5172f95 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.125690 Jun 29 08:07:59.347110 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 281/580] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jun 29 08:07:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:07:59.347561 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-71611bbe-220d-459e-9a61-5d098919576b tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c70c44993ab240b1a5231df4c9d550c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e0c37d941434569b3dbd07e22125210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:07:59.352631 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [req-ad16cd7e-2ba6-4add-bea4-6c2160029983 req-2449bdf5-cf3a-45dd-b838-3bd9bf34c642 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5d97f9b-3f4a-4a5e-89e8-98d55412fe71", "name": "network-vif-deleted", "tag": "b93d914e-7134-4247-b5f0-de80f217a1e0"}]} {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:07:59.371867 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-71611bbe-220d-459e-9a61-5d098919576b tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] 10.222.0.43 "GET /compute/v2.1/servers/d5d97f9b-3f4a-4a5e-89e8-98d55412fe71" status: 200 len: 1605 microversion: 2.1 time: 0.630809 Jun 29 08:07:59.373902 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [req-ad16cd7e-2ba6-4add-bea4-6c2160029983 req-2449bdf5-cf3a-45dd-b838-3bd9bf34c642 service nova] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:07:59.374365 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [req-ad16cd7e-2ba6-4add-bea4-6c2160029983 req-2449bdf5-cf3a-45dd-b838-3bd9bf34c642 service nova] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:07:59.385487 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 300/581] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:07:58 2022] GET /compute/v2.1/servers/d5d97f9b-3f4a-4a5e-89e8-98d55412fe71 => generated 1605 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:07:59.398789 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.compute.server_external_events [req-ad16cd7e-2ba6-4add-bea4-6c2160029983 req-2449bdf5-cf3a-45dd-b838-3bd9bf34c642 service nova] Creating event network-vif-deleted:b93d914e-7134-4247-b5f0-de80f217a1e0 for instance d5d97f9b-3f4a-4a5e-89e8-98d55412fe71 on hv-cinder-76810 Jun 29 08:07:59.411846 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [req-ad16cd7e-2ba6-4add-bea4-6c2160029983 req-2449bdf5-cf3a-45dd-b838-3bd9bf34c642 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063143 Jun 29 08:07:59.412444 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 282/582] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jun 29 08:07:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:08:00.247778 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-83ba33b4-236a-43b2-8f3a-00a974187048 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:08:00.248938 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-83ba33b4-236a-43b2-8f3a-00a974187048 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] [instance: f99567d1-cadf-40c5-b1dc-f86739b2b16c] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:08:00.271939 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-83ba33b4-236a-43b2-8f3a-00a974187048 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:08:00.272571 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-83ba33b4-236a-43b2-8f3a-00a974187048 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:08:00.279543 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-83ba33b4-236a-43b2-8f3a-00a974187048 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:08:00.280497 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-83ba33b4-236a-43b2-8f3a-00a974187048 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:08:00.311567 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.wsgi [None req-83ba33b4-236a-43b2-8f3a-00a974187048 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] HTTP exception thrown: Instance f99567d1-cadf-40c5-b1dc-f86739b2b16c could not be found. Jun 29 08:08:00.316299 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-83ba33b4-236a-43b2-8f3a-00a974187048 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Request method failure captured: Jun 29 08:08:00.316299 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: request: GET /compute/v2.1/servers/f99567d1-cadf-40c5-b1dc-f86739b2b16c HTTP/1.1 Jun 29 08:08:00.316299 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: Accept: application/json Jun 29 08:08:00.316299 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: Accept-Encoding: identity Jun 29 08:08:00.316299 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: Connection: close Jun 29 08:08:00.316299 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: Content-Length: 0 Jun 29 08:08:00.316299 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: Content-Type: application/json Jun 29 08:08:00.316299 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: Host: 10.222.0.43 Jun 29 08:08:00.316299 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: Openstack-System-Scope: None Jun 29 08:08:00.316299 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: User-Agent: python-urllib3/1.26.9 Jun 29 08:08:00.316299 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Auth-Token: gAAAAABivAc4Dw3dL_TQhYQl5Igg98aro7Udj56xbEiFVE6P-s3XIU81t9_uxZaLteFfekv5Hw9_AjoRpURcLw5l3CTAbHLq2DTKi8nbmPHhtb4ZHtMDYVQvp8Qp_4L8IbtnuCb6ruyl7a8sdsxDe_G7IpALZfBEoasd1lTOVJzsuY8CAtUkOKU Jun 29 08:08:00.316299 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Domain-Id: None Jun 29 08:08:00.316299 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Domain-Name: None Jun 29 08:08:00.316299 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Identity-Status: Confirmed Jun 29 08:08:00.316299 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Is-Admin-Project: True Jun 29 08:08:00.316299 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Openstack-Nova-Api-Version: 2.20 Jun 29 08:08:00.316299 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Project-Domain-Id: default Jun 29 08:08:00.316299 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Project-Domain-Name: Default Jun 29 08:08:00.316299 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Project-Id: 4cd09897be9c4642b91dfb53a536e7d1 Jun 29 08:08:00.316299 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1189845647 Jun 29 08:08:00.316299 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Role: member,reader Jun 29 08:08:00.316299 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Roles: member,reader Jun 29 08:08:00.318006 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/4cd09897be9c4642b91dfb53a536e7d1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_4cd09897be9c4642b91dfb53a536e7d1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/4cd09897be9c4642b91dfb53a536e7d1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/4cd09897be9c4642b91dfb53a536e7d1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Jun 29 08:08:00.318006 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1189845647 Jun 29 08:08:00.318006 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Tenant-Id: 4cd09897be9c4642b91dfb53a536e7d1 Jun 29 08:08:00.318006 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1189845647 Jun 29 08:08:00.318006 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-User: tempest-AttachVolumeShelveTestJSON-1189845647-project Jun 29 08:08:00.318006 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-User-Domain-Id: default Jun 29 08:08:00.318006 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-User-Domain-Name: Default Jun 29 08:08:00.318006 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-User-Id: c9065575ed314f6f8f3915bf596911e5 Jun 29 08:08:00.318006 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1189845647-project Jun 29 08:08:00.318006 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: method: > Jun 29 08:08:00.318006 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: exception: Instance f99567d1-cadf-40c5-b1dc-f86739b2b16c could not be found. Jun 29 08:08:00.318006 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: action_args: {'id': 'f99567d1-cadf-40c5-b1dc-f86739b2b16c'} Jun 29 08:08:00.318905 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 08:08:00.318905 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:08:00.318905 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 29 08:08:00.318905 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 29 08:08:00.318905 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 29 08:08:00.318905 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 29 08:08:00.318905 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 29 08:08:00.318905 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 29 08:08:00.318905 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 29 08:08:00.318905 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 29 08:08:00.318905 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f99567d1-cadf-40c5-b1dc-f86739b2b16c could not be found. Jun 29 08:08:00.318905 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 29 08:08:00.318905 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 08:08:00.318905 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 29 08:08:00.318905 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:08:00.318905 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 08:08:00.318905 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 08:08:00.318905 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 08:08:00.318905 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 08:08:00.318905 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 08:08:00.320307 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 08:08:00.320307 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 29 08:08:00.320307 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 29 08:08:00.320307 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 29 08:08:00.320307 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 29 08:08:00.320307 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 29 08:08:00.320307 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 29 08:08:00.320307 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f99567d1-cadf-40c5-b1dc-f86739b2b16c could not be found. Jun 29 08:08:00.320307 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 29 08:08:00.320307 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 08:08:00.320307 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 29 08:08:00.320307 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:08:00.320307 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 08:08:00.320307 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 08:08:00.320307 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 08:08:00.320307 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 08:08:00.320307 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f99567d1-cadf-40c5-b1dc-f86739b2b16c could not be found. Jun 29 08:08:00.320307 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 29 08:08:00.327040 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-83ba33b4-236a-43b2-8f3a-00a974187048 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Returning 404 to user: Instance f99567d1-cadf-40c5-b1dc-f86739b2b16c could not be found. {{(pid=117889) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 08:08:00.331791 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-83ba33b4-236a-43b2-8f3a-00a974187048 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] 10.222.0.43 "GET /compute/v2.1/servers/f99567d1-cadf-40c5-b1dc-f86739b2b16c" status: 404 len: 111 microversion: 2.20 time: 0.085230 Jun 29 08:08:00.333988 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 301/583] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 29 08:08:00 2022] GET /compute/v2.1/servers/f99567d1-cadf-40c5-b1dc-f86739b2b16c => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jun 29 08:08:00.349895 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-55624a63-2da9-409f-93b9-f5393ae6dba4 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Calling method '.version_select at 0x7f72412e1b80>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:08:00.397615 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-55624a63-2da9-409f-93b9-f5393ae6dba4 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1205330371" status: 204 len: 0 microversion: 2.20 time: 0.047746 Jun 29 08:08:00.398686 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 283/584] 10.222.0.43 () {60 vars in 1261 bytes} [Wed Jun 29 08:08:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1205330371 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jun 29 08:08:00.399467 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-41f08467-5f91-4149-8589-ef9e04cd43db tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:08:00.402512 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-41f08467-5f91-4149-8589-ef9e04cd43db tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] [instance: d5d97f9b-3f4a-4a5e-89e8-98d55412fe71] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:08:00.419255 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-41f08467-5f91-4149-8589-ef9e04cd43db tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:08:00.420307 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-41f08467-5f91-4149-8589-ef9e04cd43db tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:08:00.421969 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-41f08467-5f91-4149-8589-ef9e04cd43db tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:08:00.423684 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-41f08467-5f91-4149-8589-ef9e04cd43db tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:08:00.467915 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.wsgi [None req-41f08467-5f91-4149-8589-ef9e04cd43db tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] HTTP exception thrown: Instance d5d97f9b-3f4a-4a5e-89e8-98d55412fe71 could not be found. Jun 29 08:08:00.470634 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-41f08467-5f91-4149-8589-ef9e04cd43db tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Request method failure captured: Jun 29 08:08:00.470634 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: request: GET /compute/v2.1/servers/d5d97f9b-3f4a-4a5e-89e8-98d55412fe71 HTTP/1.1 Jun 29 08:08:00.470634 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: Accept: application/json Jun 29 08:08:00.470634 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: Accept-Encoding: identity Jun 29 08:08:00.470634 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: Connection: close Jun 29 08:08:00.470634 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: Content-Length: 0 Jun 29 08:08:00.470634 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: Content-Type: application/json Jun 29 08:08:00.470634 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: Host: 10.222.0.43 Jun 29 08:08:00.470634 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: Openstack-System-Scope: None Jun 29 08:08:00.470634 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: User-Agent: python-urllib3/1.26.9 Jun 29 08:08:00.470634 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Auth-Token: gAAAAABivAcyZeyrH2axHUIXOcPlzSz3gyuz58Vq5Ys_YNkMPTpXWZCJYExlwFCI3RcXFcV0XEjyDZvezT8IDEuTSptAu7fY1puGLXMaJYdZOKCqi6ioEaGyNbmX3l2_TOYILVhHEtKfASNvBXUCvkGa1RrAu2mrU0HWt9cDHpsWYJd2mZuJkkM Jun 29 08:08:00.470634 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Domain-Id: None Jun 29 08:08:00.470634 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Domain-Name: None Jun 29 08:08:00.470634 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Identity-Status: Confirmed Jun 29 08:08:00.470634 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Is-Admin-Project: True Jun 29 08:08:00.470634 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Project-Domain-Id: default Jun 29 08:08:00.470634 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Project-Domain-Name: Default Jun 29 08:08:00.470634 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Project-Id: 5e0c37d941434569b3dbd07e22125210 Jun 29 08:08:00.470634 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Project-Name: tempest-AttachVolumeTestJSON-2125572094 Jun 29 08:08:00.470634 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Role: member,reader Jun 29 08:08:00.470634 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Roles: member,reader Jun 29 08:08:00.472462 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5e0c37d941434569b3dbd07e22125210"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_5e0c37d941434569b3dbd07e22125210"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5e0c37d941434569b3dbd07e22125210"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/5e0c37d941434569b3dbd07e22125210"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Jun 29 08:08:00.472462 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Tenant: tempest-AttachVolumeTestJSON-2125572094 Jun 29 08:08:00.472462 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Tenant-Id: 5e0c37d941434569b3dbd07e22125210 Jun 29 08:08:00.472462 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2125572094 Jun 29 08:08:00.472462 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-User: tempest-AttachVolumeTestJSON-2125572094-project Jun 29 08:08:00.472462 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-User-Domain-Id: default Jun 29 08:08:00.472462 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-User-Domain-Name: Default Jun 29 08:08:00.472462 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-User-Id: c70c44993ab240b1a5231df4c9d550c9 Jun 29 08:08:00.472462 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-User-Name: tempest-AttachVolumeTestJSON-2125572094-project Jun 29 08:08:00.472462 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: method: > Jun 29 08:08:00.472462 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: exception: Instance d5d97f9b-3f4a-4a5e-89e8-98d55412fe71 could not be found. Jun 29 08:08:00.472462 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: action_args: {'id': 'd5d97f9b-3f4a-4a5e-89e8-98d55412fe71'} Jun 29 08:08:00.473426 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 08:08:00.473426 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:08:00.473426 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 29 08:08:00.473426 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 29 08:08:00.473426 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 29 08:08:00.473426 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 29 08:08:00.473426 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 29 08:08:00.473426 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 29 08:08:00.473426 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 29 08:08:00.473426 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 29 08:08:00.473426 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d5d97f9b-3f4a-4a5e-89e8-98d55412fe71 could not be found. Jun 29 08:08:00.473426 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 29 08:08:00.473426 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 08:08:00.473426 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 29 08:08:00.473426 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:08:00.473426 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 08:08:00.473426 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 08:08:00.473426 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 08:08:00.473426 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 08:08:00.473426 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 08:08:00.474824 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 08:08:00.474824 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 29 08:08:00.474824 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 29 08:08:00.474824 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 29 08:08:00.474824 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 29 08:08:00.474824 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 29 08:08:00.474824 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 29 08:08:00.474824 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d5d97f9b-3f4a-4a5e-89e8-98d55412fe71 could not be found. Jun 29 08:08:00.474824 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 29 08:08:00.474824 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 08:08:00.474824 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 29 08:08:00.474824 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:08:00.474824 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 08:08:00.474824 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 08:08:00.474824 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 08:08:00.474824 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 08:08:00.474824 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d5d97f9b-3f4a-4a5e-89e8-98d55412fe71 could not be found. Jun 29 08:08:00.474824 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 29 08:08:00.477017 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-41f08467-5f91-4149-8589-ef9e04cd43db tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Returning 404 to user: Instance d5d97f9b-3f4a-4a5e-89e8-98d55412fe71 could not be found. {{(pid=117889) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 08:08:00.478073 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-41f08467-5f91-4149-8589-ef9e04cd43db tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] 10.222.0.43 "GET /compute/v2.1/servers/d5d97f9b-3f4a-4a5e-89e8-98d55412fe71" status: 404 len: 111 microversion: 2.1 time: 0.089246 Jun 29 08:08:00.478645 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 302/585] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:08:00 2022] GET /compute/v2.1/servers/d5d97f9b-3f4a-4a5e-89e8-98d55412fe71 => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 29 08:08:00.489302 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-18e41333-0178-402e-9cb4-7a3ea0da0f91 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Calling method '.version_select at 0x7f72412afca0>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:08:00.514175 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-18e41333-0178-402e-9cb4-7a3ea0da0f91 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1021976267" status: 202 len: 0 microversion: 2.1 time: 0.030187 Jun 29 08:08:00.529948 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 284/586] 10.222.0.43 () {58 vars in 1220 bytes} [Wed Jun 29 08:08:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1021976267 => generated 0 bytes in 47 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 29 08:08:01.327776 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-b53ca8d7-c8f9-46ff-bd70-218c209f064d tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Action: 'create', calling method: .version_select at 0x7f7243330ee0>, body: {"keypair": {"name": "tempest-keypair-514829004", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK59gvDJMkqhuIxATukqa0G1Z2Aw+BqygZOPXs8G6Wttir7JwJ2rWQUJEq1ikspuQS9MORqNWeSFBFx4LcyinUByvjQGry2Zv6olzQrNLqEmdnWQ6IYUyqVnDN5EpaYTkQ=="}} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:08:01.342974 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.quota [None req-b53ca8d7-c8f9-46ff-bd70-218c209f064d tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Getting quotas for project 4cd09897be9c4642b91dfb53a536e7d1. Resources: {'key_pairs'} {{(pid=117889) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 29 08:08:01.347432 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.quota [None req-b53ca8d7-c8f9-46ff-bd70-218c209f064d tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Getting quotas for user c9065575ed314f6f8f3915bf596911e5 and project 4cd09897be9c4642b91dfb53a536e7d1. Resources: {'key_pairs'} {{(pid=117889) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 29 08:08:01.383334 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-b53ca8d7-c8f9-46ff-bd70-218c209f064d tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.059552 Jun 29 08:08:01.385378 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 303/587] 10.222.0.43 () {62 vars in 1199 bytes} [Wed Jun 29 08:08:01 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 62 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 29 08:08:01.504407 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-79183bf7-8200-4999-a821-441f898a6b45 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Action: 'create', calling method: .version_select at 0x7f7241340820>, body: {"keypair": {"name": "tempest-keypair-1827614167", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAPCru376MWUlf6/J6Mhw5GqUf+M+tvRx9q1595B3+wKwiB0K2KFm54Y55DyoKYDaK7hst8xc2S9dks7L4s4ptZ3+UBHHti3bW39BmNoltkcK4Y2dF3U8JukAowoMsVaYw=="}} {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:08:01.524051 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.quota [None req-79183bf7-8200-4999-a821-441f898a6b45 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Getting quotas for project 5e0c37d941434569b3dbd07e22125210. Resources: {'key_pairs'} {{(pid=117890) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 29 08:08:01.529140 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.quota [None req-79183bf7-8200-4999-a821-441f898a6b45 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Getting quotas for user c70c44993ab240b1a5231df4c9d550c9 and project 5e0c37d941434569b3dbd07e22125210. Resources: {'key_pairs'} {{(pid=117890) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 29 08:08:01.561209 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-79183bf7-8200-4999-a821-441f898a6b45 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.060632 Jun 29 08:08:01.565126 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 285/588] 10.222.0.43 () {60 vars in 1158 bytes} [Wed Jun 29 08:08:01 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:08:03.220540 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-2c115e10-c657-4634-9d74-e8e03c71f914 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1887183102", "imageRef": "5d2148a0-3628-4eff-88e9-5686abc0d33e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "83284d8b-f58e-483b-bfde-1c25f92d3de3"}], "security_groups": [{"name": "tempest-securitygroup--1624115519"}], "key_name": "tempest-keypair-1827614167", "user_data": "}} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:08:03.251377 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-b91f6181-b15d-4cd3-b79b-9b7f14eaf692 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1547694440", "imageRef": "5d2148a0-3628-4eff-88e9-5686abc0d33e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2f3afbc5-288f-4461-967f-3d79e5607ae1"}], "security_groups": [{"name": "tempest-securitygroup--935438314"}], "key_name": "tempest-keypair-514829004", "user_data": "}} {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:08:03.362701 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.network.neutron [None req-b91f6181-b15d-4cd3-b79b-9b7f14eaf692 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] validate_networks() for [('2f3afbc5-288f-4461-967f-3d79e5607ae1', None, None, None, None, None)] {{(pid=117890) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 29 08:08:03.518918 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.network.neutron [None req-2c115e10-c657-4634-9d74-e8e03c71f914 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] validate_networks() for [('83284d8b-f58e-483b-bfde-1c25f92d3de3', None, None, None, None, None)] {{(pid=117889) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 29 08:08:03.917595 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.virt.hardware [None req-b91f6181-b15d-4cd3-b79b-9b7f14eaf692 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Flavor limits 0:0:0 {{(pid=117890) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 29 08:08:03.918024 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.virt.hardware [None req-b91f6181-b15d-4cd3-b79b-9b7f14eaf692 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Image limits 0:0:0 {{(pid=117890) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 29 08:08:03.918512 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.virt.hardware [None req-b91f6181-b15d-4cd3-b79b-9b7f14eaf692 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Flavor pref 0:0:0 {{(pid=117890) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 29 08:08:03.921303 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.virt.hardware [None req-b91f6181-b15d-4cd3-b79b-9b7f14eaf692 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Image pref 0:0:0 {{(pid=117890) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 29 08:08:03.921303 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.virt.hardware [None req-b91f6181-b15d-4cd3-b79b-9b7f14eaf692 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117890) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 29 08:08:03.929738 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-b91f6181-b15d-4cd3-b79b-9b7f14eaf692 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:08:03.930185 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-b91f6181-b15d-4cd3-b79b-9b7f14eaf692 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:08:03.931017 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-b91f6181-b15d-4cd3-b79b-9b7f14eaf692 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:08:03.931460 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-b91f6181-b15d-4cd3-b79b-9b7f14eaf692 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:08:03.949057 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.quota [None req-b91f6181-b15d-4cd3-b79b-9b7f14eaf692 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Getting quotas for project 4cd09897be9c4642b91dfb53a536e7d1. Resources: {'ram', 'instances', 'cores'} {{(pid=117890) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 29 08:08:03.953088 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.quota [None req-b91f6181-b15d-4cd3-b79b-9b7f14eaf692 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Getting quotas for user c9065575ed314f6f8f3915bf596911e5 and project 4cd09897be9c4642b91dfb53a536e7d1. Resources: {'ram', 'instances', 'cores'} {{(pid=117890) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 29 08:08:03.964585 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-b91f6181-b15d-4cd3-b79b-9b7f14eaf692 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Going to run 1 instances... {{(pid=117890) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 29 08:08:03.967030 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-b91f6181-b15d-4cd3-b79b-9b7f14eaf692 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] [instance: 4e4c90a0-14de-401e-80d5-fe4bf684d991] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5d2148a0-3628-4eff-88e9-5686abc0d33e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117890) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 29 08:08:04.010974 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.virt.hardware [None req-2c115e10-c657-4634-9d74-e8e03c71f914 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Flavor limits 0:0:0 {{(pid=117889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 29 08:08:04.010974 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.virt.hardware [None req-2c115e10-c657-4634-9d74-e8e03c71f914 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Image limits 0:0:0 {{(pid=117889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 29 08:08:04.010974 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.virt.hardware [None req-2c115e10-c657-4634-9d74-e8e03c71f914 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Flavor pref 0:0:0 {{(pid=117889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 29 08:08:04.010974 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.virt.hardware [None req-2c115e10-c657-4634-9d74-e8e03c71f914 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Image pref 0:0:0 {{(pid=117889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 29 08:08:04.010974 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.virt.hardware [None req-2c115e10-c657-4634-9d74-e8e03c71f914 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 29 08:08:04.018031 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-b91f6181-b15d-4cd3-b79b-9b7f14eaf692 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.771338 Jun 29 08:08:04.018944 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 286/589] 10.222.0.43 () {62 vars in 1187 bytes} [Wed Jun 29 08:08:03 2022] POST /compute/v2.1/servers => generated 401 bytes in 773 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Jun 29 08:08:04.020294 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-2c115e10-c657-4634-9d74-e8e03c71f914 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:08:04.020760 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-2c115e10-c657-4634-9d74-e8e03c71f914 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:08:04.021612 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-2c115e10-c657-4634-9d74-e8e03c71f914 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:08:04.022050 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-2c115e10-c657-4634-9d74-e8e03c71f914 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:08:04.050273 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.quota [None req-2c115e10-c657-4634-9d74-e8e03c71f914 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Getting quotas for project 5e0c37d941434569b3dbd07e22125210. Resources: {'ram', 'instances', 'cores'} {{(pid=117889) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 29 08:08:04.055010 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.quota [None req-2c115e10-c657-4634-9d74-e8e03c71f914 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Getting quotas for user c70c44993ab240b1a5231df4c9d550c9 and project 5e0c37d941434569b3dbd07e22125210. Resources: {'ram', 'instances', 'cores'} {{(pid=117889) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 29 08:08:04.066816 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-2c115e10-c657-4634-9d74-e8e03c71f914 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Going to run 1 instances... {{(pid=117889) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 29 08:08:04.069135 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-2c115e10-c657-4634-9d74-e8e03c71f914 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] [instance: d7e8f0a8-6cfe-4b0e-818a-a078672dbd87] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5d2148a0-3628-4eff-88e9-5686abc0d33e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117889) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 29 08:08:04.105567 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-7995793b-4886-4b3c-8fb6-250bdc3d4701 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:08:04.106626 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-7995793b-4886-4b3c-8fb6-250bdc3d4701 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] [instance: 4e4c90a0-14de-401e-80d5-fe4bf684d991] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:08:04.122690 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-2c115e10-c657-4634-9d74-e8e03c71f914 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.907541 Jun 29 08:08:04.123755 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 304/590] 10.222.0.43 () {60 vars in 1146 bytes} [Wed Jun 29 08:08:03 2022] POST /compute/v2.1/servers => generated 402 bytes in 910 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 29 08:08:04.134500 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-1b9f882b-600b-47dc-bcd9-b1697bc73d52 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:08:04.137269 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-1b9f882b-600b-47dc-bcd9-b1697bc73d52 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] [instance: d7e8f0a8-6cfe-4b0e-818a-a078672dbd87] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:08:04.193805 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-7995793b-4886-4b3c-8fb6-250bdc3d4701 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:08:04.203327 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-7995793b-4886-4b3c-8fb6-250bdc3d4701 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:08:04.205422 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-7995793b-4886-4b3c-8fb6-250bdc3d4701 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:08:04.207574 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-7995793b-4886-4b3c-8fb6-250bdc3d4701 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] 10.222.0.43 "GET /compute/v2.1/servers/4e4c90a0-14de-401e-80d5-fe4bf684d991" status: 200 len: 1281 microversion: 2.20 time: 0.181039 Jun 29 08:08:04.208140 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 287/591] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 29 08:08:04 2022] GET /compute/v2.1/servers/4e4c90a0-14de-401e-80d5-fe4bf684d991 => generated 1281 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:08:04.222341 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-1b9f882b-600b-47dc-bcd9-b1697bc73d52 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c70c44993ab240b1a5231df4c9d550c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e0c37d941434569b3dbd07e22125210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:08:04.229388 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-1b9f882b-600b-47dc-bcd9-b1697bc73d52 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] 10.222.0.43 "GET /compute/v2.1/servers/d7e8f0a8-6cfe-4b0e-818a-a078672dbd87" status: 200 len: 1238 microversion: 2.1 time: 0.098826 Jun 29 08:08:04.229947 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 305/592] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:08:04 2022] GET /compute/v2.1/servers/d7e8f0a8-6cfe-4b0e-818a-a078672dbd87 => generated 1238 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 08:08:05.227507 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-4ceb4119-fad0-48e5-9c60-3de008575074 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:08:05.228169 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-4ceb4119-fad0-48e5-9c60-3de008575074 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] [instance: 4e4c90a0-14de-401e-80d5-fe4bf684d991] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:08:05.238072 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-4ceb4119-fad0-48e5-9c60-3de008575074 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:08:05.238553 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-4ceb4119-fad0-48e5-9c60-3de008575074 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:08:05.239367 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-4ceb4119-fad0-48e5-9c60-3de008575074 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:08:05.239875 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-4ceb4119-fad0-48e5-9c60-3de008575074 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:08:05.248622 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-1040189e-c788-4c24-9729-64a79c36ab23 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:08:05.250102 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-1040189e-c788-4c24-9729-64a79c36ab23 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] [instance: d7e8f0a8-6cfe-4b0e-818a-a078672dbd87] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:08:05.260550 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-1040189e-c788-4c24-9729-64a79c36ab23 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:08:05.261234 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-1040189e-c788-4c24-9729-64a79c36ab23 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:08:05.262255 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-1040189e-c788-4c24-9729-64a79c36ab23 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:08:05.262955 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-1040189e-c788-4c24-9729-64a79c36ab23 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:08:05.323112 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-4ceb4119-fad0-48e5-9c60-3de008575074 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:08:05.332148 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-4ceb4119-fad0-48e5-9c60-3de008575074 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:08:05.333730 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-4ceb4119-fad0-48e5-9c60-3de008575074 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:08:05.334865 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-4ceb4119-fad0-48e5-9c60-3de008575074 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] 10.222.0.43 "GET /compute/v2.1/servers/4e4c90a0-14de-401e-80d5-fe4bf684d991" status: 200 len: 1333 microversion: 2.20 time: 0.112206 Jun 29 08:08:05.335689 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 288/593] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 29 08:08:05 2022] GET /compute/v2.1/servers/4e4c90a0-14de-401e-80d5-fe4bf684d991 => generated 1333 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 29 08:08:05.346249 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-1040189e-c788-4c24-9729-64a79c36ab23 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c70c44993ab240b1a5231df4c9d550c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e0c37d941434569b3dbd07e22125210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:08:05.353778 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-1040189e-c788-4c24-9729-64a79c36ab23 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] 10.222.0.43 "GET /compute/v2.1/servers/d7e8f0a8-6cfe-4b0e-818a-a078672dbd87" status: 200 len: 1298 microversion: 2.1 time: 0.110206 Jun 29 08:08:05.354344 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 306/594] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:08:05 2022] GET /compute/v2.1/servers/d7e8f0a8-6cfe-4b0e-818a-a078672dbd87 => generated 1298 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 08:08:06.352173 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-edfbb418-f660-4c99-a687-54a4403990b5 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:08:06.352792 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-edfbb418-f660-4c99-a687-54a4403990b5 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] [instance: 4e4c90a0-14de-401e-80d5-fe4bf684d991] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:08:06.361420 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-edfbb418-f660-4c99-a687-54a4403990b5 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:08:06.362035 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-edfbb418-f660-4c99-a687-54a4403990b5 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:08:06.362993 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-edfbb418-f660-4c99-a687-54a4403990b5 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:08:06.363578 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-edfbb418-f660-4c99-a687-54a4403990b5 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:08:06.371356 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-29f53960-e54e-4f0a-afae-a92992bf7bc7 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:08:06.375110 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-29f53960-e54e-4f0a-afae-a92992bf7bc7 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] [instance: d7e8f0a8-6cfe-4b0e-818a-a078672dbd87] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:08:06.385384 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-29f53960-e54e-4f0a-afae-a92992bf7bc7 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:08:06.386348 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-29f53960-e54e-4f0a-afae-a92992bf7bc7 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:08:06.387405 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-29f53960-e54e-4f0a-afae-a92992bf7bc7 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:08:06.388057 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-29f53960-e54e-4f0a-afae-a92992bf7bc7 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:08:06.454758 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-edfbb418-f660-4c99-a687-54a4403990b5 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:08:06.465555 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-edfbb418-f660-4c99-a687-54a4403990b5 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:08:06.467712 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-edfbb418-f660-4c99-a687-54a4403990b5 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:08:06.471105 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-edfbb418-f660-4c99-a687-54a4403990b5 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] 10.222.0.43 "GET /compute/v2.1/servers/4e4c90a0-14de-401e-80d5-fe4bf684d991" status: 200 len: 1339 microversion: 2.20 time: 0.121796 Jun 29 08:08:06.473196 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 289/595] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 29 08:08:06 2022] GET /compute/v2.1/servers/4e4c90a0-14de-401e-80d5-fe4bf684d991 => generated 1339 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:08:06.640960 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-29f53960-e54e-4f0a-afae-a92992bf7bc7 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c70c44993ab240b1a5231df4c9d550c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e0c37d941434569b3dbd07e22125210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:08:06.656423 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-29f53960-e54e-4f0a-afae-a92992bf7bc7 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] 10.222.0.43 "GET /compute/v2.1/servers/d7e8f0a8-6cfe-4b0e-818a-a078672dbd87" status: 200 len: 1364 microversion: 2.1 time: 0.289033 Jun 29 08:08:06.658886 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 307/596] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:08:06 2022] GET /compute/v2.1/servers/d7e8f0a8-6cfe-4b0e-818a-a078672dbd87 => generated 1364 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 08:08:07.193314 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [req-96f8c7be-bc93-42f0-bd4f-c9737242d238 req-6b90fd43-a0eb-491a-a9ba-068d7064ea34 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d7e8f0a8-6cfe-4b0e-818a-a078672dbd87", "tag": "d0e3ab57-a5ac-41d7-84d7-f243539f967b"}]} {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:08:07.203234 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [req-96f8c7be-bc93-42f0-bd4f-c9737242d238 req-6b90fd43-a0eb-491a-a9ba-068d7064ea34 service nova] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:08:07.206445 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [req-96f8c7be-bc93-42f0-bd4f-c9737242d238 req-6b90fd43-a0eb-491a-a9ba-068d7064ea34 service nova] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:08:07.221513 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.compute.server_external_events [req-96f8c7be-bc93-42f0-bd4f-c9737242d238 req-6b90fd43-a0eb-491a-a9ba-068d7064ea34 service nova] Creating event network-changed:d0e3ab57-a5ac-41d7-84d7-f243539f967b for instance d7e8f0a8-6cfe-4b0e-818a-a078672dbd87 on hv-cinder-76810 Jun 29 08:08:07.230339 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [req-96f8c7be-bc93-42f0-bd4f-c9737242d238 req-6b90fd43-a0eb-491a-a9ba-068d7064ea34 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040850 Jun 29 08:08:07.237694 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 290/597] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jun 29 08:08:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:08:07.493112 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-277d0a44-ae7a-4627-89f4-5f9ce004ac69 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:08:07.494200 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-277d0a44-ae7a-4627-89f4-5f9ce004ac69 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] [instance: 4e4c90a0-14de-401e-80d5-fe4bf684d991] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:08:07.505838 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-277d0a44-ae7a-4627-89f4-5f9ce004ac69 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:08:07.506445 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-277d0a44-ae7a-4627-89f4-5f9ce004ac69 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:08:07.507320 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-277d0a44-ae7a-4627-89f4-5f9ce004ac69 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:08:07.511251 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-277d0a44-ae7a-4627-89f4-5f9ce004ac69 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:08:07.611327 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [req-bf37f4c6-e1ce-4cef-9c13-4138774579d0 req-ada25d8f-8ba7-4ead-a4c7-69cf1fa9aa98 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e4c90a0-14de-401e-80d5-fe4bf684d991", "tag": "747dea80-5c60-451c-bba1-3aabe38a1272"}]} {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:08:07.628071 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [req-bf37f4c6-e1ce-4cef-9c13-4138774579d0 req-ada25d8f-8ba7-4ead-a4c7-69cf1fa9aa98 service nova] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:08:07.628685 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [req-bf37f4c6-e1ce-4cef-9c13-4138774579d0 req-ada25d8f-8ba7-4ead-a4c7-69cf1fa9aa98 service nova] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:08:07.643256 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.compute.server_external_events [req-bf37f4c6-e1ce-4cef-9c13-4138774579d0 req-ada25d8f-8ba7-4ead-a4c7-69cf1fa9aa98 service nova] Creating event network-changed:747dea80-5c60-451c-bba1-3aabe38a1272 for instance 4e4c90a0-14de-401e-80d5-fe4bf684d991 on hv-cinder-76810 Jun 29 08:08:07.648934 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [req-bf37f4c6-e1ce-4cef-9c13-4138774579d0 req-ada25d8f-8ba7-4ead-a4c7-69cf1fa9aa98 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047135 Jun 29 08:08:07.653340 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 291/598] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jun 29 08:08:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:08:07.679012 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-d87a2747-8b6f-4505-af7e-83709cfcc1fe tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:08:07.679888 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-d87a2747-8b6f-4505-af7e-83709cfcc1fe tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] [instance: d7e8f0a8-6cfe-4b0e-818a-a078672dbd87] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:08:07.687676 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-d87a2747-8b6f-4505-af7e-83709cfcc1fe tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:08:07.688920 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-d87a2747-8b6f-4505-af7e-83709cfcc1fe tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:08:07.690020 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-d87a2747-8b6f-4505-af7e-83709cfcc1fe tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:08:07.690578 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-d87a2747-8b6f-4505-af7e-83709cfcc1fe tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:08:07.770875 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-277d0a44-ae7a-4627-89f4-5f9ce004ac69 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:08:07.793415 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-277d0a44-ae7a-4627-89f4-5f9ce004ac69 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:08:07.798163 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-277d0a44-ae7a-4627-89f4-5f9ce004ac69 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:08:07.800925 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-277d0a44-ae7a-4627-89f4-5f9ce004ac69 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] 10.222.0.43 "GET /compute/v2.1/servers/4e4c90a0-14de-401e-80d5-fe4bf684d991" status: 200 len: 1406 microversion: 2.20 time: 0.313110 Jun 29 08:08:07.803699 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 308/599] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 29 08:08:07 2022] GET /compute/v2.1/servers/4e4c90a0-14de-401e-80d5-fe4bf684d991 => generated 1406 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:08:07.945769 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-d87a2747-8b6f-4505-af7e-83709cfcc1fe tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c70c44993ab240b1a5231df4c9d550c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e0c37d941434569b3dbd07e22125210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:08:07.955421 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-d87a2747-8b6f-4505-af7e-83709cfcc1fe tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] 10.222.0.43 "GET /compute/v2.1/servers/d7e8f0a8-6cfe-4b0e-818a-a078672dbd87" status: 200 len: 1364 microversion: 2.1 time: 0.281500 Jun 29 08:08:07.955633 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 292/600] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:08:07 2022] GET /compute/v2.1/servers/d7e8f0a8-6cfe-4b0e-818a-a078672dbd87 => generated 1364 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 08:08:08.820476 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-5c0a684d-14d6-4f3a-b5c8-4deac7be0336 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:08:08.821213 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-5c0a684d-14d6-4f3a-b5c8-4deac7be0336 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] [instance: 4e4c90a0-14de-401e-80d5-fe4bf684d991] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:08:08.828473 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-5c0a684d-14d6-4f3a-b5c8-4deac7be0336 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:08:08.829515 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-5c0a684d-14d6-4f3a-b5c8-4deac7be0336 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:08:08.830838 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-5c0a684d-14d6-4f3a-b5c8-4deac7be0336 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:08:08.831354 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-5c0a684d-14d6-4f3a-b5c8-4deac7be0336 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:08:08.973202 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-211d16bb-b284-44e8-87b0-304f58ab95be tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:08:08.973962 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-211d16bb-b284-44e8-87b0-304f58ab95be tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] [instance: d7e8f0a8-6cfe-4b0e-818a-a078672dbd87] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:08:08.979125 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-5c0a684d-14d6-4f3a-b5c8-4deac7be0336 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:08:08.982148 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-211d16bb-b284-44e8-87b0-304f58ab95be tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:08:08.982854 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-211d16bb-b284-44e8-87b0-304f58ab95be tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:08:08.983904 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-211d16bb-b284-44e8-87b0-304f58ab95be tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:08:08.984424 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-211d16bb-b284-44e8-87b0-304f58ab95be tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:08:08.988950 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-5c0a684d-14d6-4f3a-b5c8-4deac7be0336 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:08:08.990491 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-5c0a684d-14d6-4f3a-b5c8-4deac7be0336 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:08:08.991653 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-5c0a684d-14d6-4f3a-b5c8-4deac7be0336 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] 10.222.0.43 "GET /compute/v2.1/servers/4e4c90a0-14de-401e-80d5-fe4bf684d991" status: 200 len: 1406 microversion: 2.20 time: 0.175493 Jun 29 08:08:08.992600 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 309/601] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 29 08:08:08 2022] GET /compute/v2.1/servers/4e4c90a0-14de-401e-80d5-fe4bf684d991 => generated 1406 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:08:09.197576 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-211d16bb-b284-44e8-87b0-304f58ab95be tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c70c44993ab240b1a5231df4c9d550c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e0c37d941434569b3dbd07e22125210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:08:09.206423 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-211d16bb-b284-44e8-87b0-304f58ab95be tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] 10.222.0.43 "GET /compute/v2.1/servers/d7e8f0a8-6cfe-4b0e-818a-a078672dbd87" status: 200 len: 1364 microversion: 2.1 time: 0.237614 Jun 29 08:08:09.207368 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 293/602] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:08:08 2022] GET /compute/v2.1/servers/d7e8f0a8-6cfe-4b0e-818a-a078672dbd87 => generated 1364 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 08:08:10.010872 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-c9f54646-0672-47c9-9c0c-200b05b2754c tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:08:10.011466 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-c9f54646-0672-47c9-9c0c-200b05b2754c tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] [instance: 4e4c90a0-14de-401e-80d5-fe4bf684d991] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:08:10.018699 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c9f54646-0672-47c9-9c0c-200b05b2754c tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:08:10.019147 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c9f54646-0672-47c9-9c0c-200b05b2754c tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:08:10.019922 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c9f54646-0672-47c9-9c0c-200b05b2754c tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:08:10.020366 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c9f54646-0672-47c9-9c0c-200b05b2754c tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:08:10.157692 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-c9f54646-0672-47c9-9c0c-200b05b2754c tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:08:10.166137 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-c9f54646-0672-47c9-9c0c-200b05b2754c tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:08:10.167657 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-c9f54646-0672-47c9-9c0c-200b05b2754c tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:08:10.168773 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-c9f54646-0672-47c9-9c0c-200b05b2754c tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] 10.222.0.43 "GET /compute/v2.1/servers/4e4c90a0-14de-401e-80d5-fe4bf684d991" status: 200 len: 1406 microversion: 2.20 time: 0.161830 Jun 29 08:08:10.169376 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 310/603] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 29 08:08:10 2022] GET /compute/v2.1/servers/4e4c90a0-14de-401e-80d5-fe4bf684d991 => generated 1406 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:08:10.224960 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-973e5e5c-de19-47c4-8bbe-96fa8f729b4c tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:08:10.225609 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-973e5e5c-de19-47c4-8bbe-96fa8f729b4c tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] [instance: d7e8f0a8-6cfe-4b0e-818a-a078672dbd87] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:08:10.232436 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-973e5e5c-de19-47c4-8bbe-96fa8f729b4c tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:08:10.232894 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-973e5e5c-de19-47c4-8bbe-96fa8f729b4c tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:08:10.233731 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-973e5e5c-de19-47c4-8bbe-96fa8f729b4c tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:08:10.234172 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-973e5e5c-de19-47c4-8bbe-96fa8f729b4c tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:08:10.377487 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-973e5e5c-de19-47c4-8bbe-96fa8f729b4c tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c70c44993ab240b1a5231df4c9d550c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e0c37d941434569b3dbd07e22125210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:08:10.396070 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-973e5e5c-de19-47c4-8bbe-96fa8f729b4c tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] 10.222.0.43 "GET /compute/v2.1/servers/d7e8f0a8-6cfe-4b0e-818a-a078672dbd87" status: 200 len: 1364 microversion: 2.1 time: 0.175224 Jun 29 08:08:10.397065 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 294/604] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:08:10 2022] GET /compute/v2.1/servers/d7e8f0a8-6cfe-4b0e-818a-a078672dbd87 => generated 1364 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:08:11.188966 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-80fb0aae-4592-4e7e-bbe2-a516b5a149b0 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:08:11.189697 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-80fb0aae-4592-4e7e-bbe2-a516b5a149b0 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] [instance: 4e4c90a0-14de-401e-80d5-fe4bf684d991] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:08:11.196098 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-80fb0aae-4592-4e7e-bbe2-a516b5a149b0 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:08:11.196546 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-80fb0aae-4592-4e7e-bbe2-a516b5a149b0 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:08:11.197353 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-80fb0aae-4592-4e7e-bbe2-a516b5a149b0 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:08:11.197799 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-80fb0aae-4592-4e7e-bbe2-a516b5a149b0 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:08:11.334101 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-80fb0aae-4592-4e7e-bbe2-a516b5a149b0 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:08:11.337690 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:08:11.343516 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-80fb0aae-4592-4e7e-bbe2-a516b5a149b0 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:08:11.345637 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-80fb0aae-4592-4e7e-bbe2-a516b5a149b0 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:08:11.346763 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-80fb0aae-4592-4e7e-bbe2-a516b5a149b0 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] 10.222.0.43 "GET /compute/v2.1/servers/4e4c90a0-14de-401e-80d5-fe4bf684d991" status: 200 len: 1406 microversion: 2.20 time: 0.162503 Jun 29 08:08:11.347328 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 311/605] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 29 08:08:11 2022] GET /compute/v2.1/servers/4e4c90a0-14de-401e-80d5-fe4bf684d991 => generated 1406 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:08:11.414006 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-389d3a5a-ae14-49cf-8844-e601b8cb80da tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:08:11.414623 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-389d3a5a-ae14-49cf-8844-e601b8cb80da tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] [instance: d7e8f0a8-6cfe-4b0e-818a-a078672dbd87] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:08:11.421676 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-389d3a5a-ae14-49cf-8844-e601b8cb80da tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:08:11.422128 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-389d3a5a-ae14-49cf-8844-e601b8cb80da tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:08:11.422921 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-389d3a5a-ae14-49cf-8844-e601b8cb80da tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:08:11.423358 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-389d3a5a-ae14-49cf-8844-e601b8cb80da tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:08:11.559266 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-389d3a5a-ae14-49cf-8844-e601b8cb80da tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c70c44993ab240b1a5231df4c9d550c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e0c37d941434569b3dbd07e22125210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:08:11.567832 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-389d3a5a-ae14-49cf-8844-e601b8cb80da tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] 10.222.0.43 "GET /compute/v2.1/servers/d7e8f0a8-6cfe-4b0e-818a-a078672dbd87" status: 200 len: 1364 microversion: 2.1 time: 0.157744 Jun 29 08:08:11.568403 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 295/606] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:08:11 2022] GET /compute/v2.1/servers/d7e8f0a8-6cfe-4b0e-818a-a078672dbd87 => generated 1364 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:08:12.366530 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-bc2f884b-e12e-403b-9347-04fa24af3bf5 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:08:12.367234 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-bc2f884b-e12e-403b-9347-04fa24af3bf5 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] [instance: 4e4c90a0-14de-401e-80d5-fe4bf684d991] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:08:12.374490 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-bc2f884b-e12e-403b-9347-04fa24af3bf5 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:08:12.374960 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-bc2f884b-e12e-403b-9347-04fa24af3bf5 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:08:12.376448 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-bc2f884b-e12e-403b-9347-04fa24af3bf5 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:08:12.376950 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-bc2f884b-e12e-403b-9347-04fa24af3bf5 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:08:12.517285 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-bc2f884b-e12e-403b-9347-04fa24af3bf5 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:08:12.525899 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-bc2f884b-e12e-403b-9347-04fa24af3bf5 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:08:12.527428 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-bc2f884b-e12e-403b-9347-04fa24af3bf5 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:08:12.528578 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-bc2f884b-e12e-403b-9347-04fa24af3bf5 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] 10.222.0.43 "GET /compute/v2.1/servers/4e4c90a0-14de-401e-80d5-fe4bf684d991" status: 200 len: 1406 microversion: 2.20 time: 0.167169 Jun 29 08:08:12.529186 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 312/607] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 29 08:08:12 2022] GET /compute/v2.1/servers/4e4c90a0-14de-401e-80d5-fe4bf684d991 => generated 1406 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:08:12.584133 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-904da7f7-9694-4fea-a960-1ee1ad2244a3 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:08:12.584856 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-904da7f7-9694-4fea-a960-1ee1ad2244a3 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] [instance: d7e8f0a8-6cfe-4b0e-818a-a078672dbd87] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:08:12.591780 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-904da7f7-9694-4fea-a960-1ee1ad2244a3 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:08:12.592305 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-904da7f7-9694-4fea-a960-1ee1ad2244a3 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:08:12.593152 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-904da7f7-9694-4fea-a960-1ee1ad2244a3 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:08:12.593582 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-904da7f7-9694-4fea-a960-1ee1ad2244a3 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:08:12.733954 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-904da7f7-9694-4fea-a960-1ee1ad2244a3 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c70c44993ab240b1a5231df4c9d550c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e0c37d941434569b3dbd07e22125210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:08:12.742034 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-904da7f7-9694-4fea-a960-1ee1ad2244a3 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] 10.222.0.43 "GET /compute/v2.1/servers/d7e8f0a8-6cfe-4b0e-818a-a078672dbd87" status: 200 len: 1364 microversion: 2.1 time: 0.162045 Jun 29 08:08:12.742695 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 296/608] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:08:12 2022] GET /compute/v2.1/servers/d7e8f0a8-6cfe-4b0e-818a-a078672dbd87 => generated 1364 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:08:12.842878 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [req-8536d7c8-1c10-427c-8a32-22fb19a94e24 req-c7470111-f2ad-403d-b780-c06d770d36da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7e8f0a8-6cfe-4b0e-818a-a078672dbd87", "name": "network-vif-plugged", "status": "completed", "tag": "d0e3ab57-a5ac-41d7-84d7-f243539f967b"}]} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:08:12.856624 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-8536d7c8-1c10-427c-8a32-22fb19a94e24 req-c7470111-f2ad-403d-b780-c06d770d36da service nova] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:08:12.857494 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-8536d7c8-1c10-427c-8a32-22fb19a94e24 req-c7470111-f2ad-403d-b780-c06d770d36da service nova] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:08:12.875578 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.compute.server_external_events [req-8536d7c8-1c10-427c-8a32-22fb19a94e24 req-c7470111-f2ad-403d-b780-c06d770d36da service nova] Creating event network-vif-plugged:d0e3ab57-a5ac-41d7-84d7-f243539f967b for instance d7e8f0a8-6cfe-4b0e-818a-a078672dbd87 on hv-cinder-76810 Jun 29 08:08:12.881595 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [req-8536d7c8-1c10-427c-8a32-22fb19a94e24 req-c7470111-f2ad-403d-b780-c06d770d36da service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042676 Jun 29 08:08:12.882549 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 313/609] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jun 29 08:08:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:08:13.547060 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-a34c6532-34a2-44bc-9da9-641a9bc435a6 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:08:13.548471 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-a34c6532-34a2-44bc-9da9-641a9bc435a6 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] [instance: 4e4c90a0-14de-401e-80d5-fe4bf684d991] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:08:13.555408 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-a34c6532-34a2-44bc-9da9-641a9bc435a6 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:08:13.555976 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-a34c6532-34a2-44bc-9da9-641a9bc435a6 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:08:13.556853 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-a34c6532-34a2-44bc-9da9-641a9bc435a6 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:08:13.557429 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-a34c6532-34a2-44bc-9da9-641a9bc435a6 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:08:13.696419 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-a34c6532-34a2-44bc-9da9-641a9bc435a6 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:08:13.704823 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-a34c6532-34a2-44bc-9da9-641a9bc435a6 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:08:13.706372 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-a34c6532-34a2-44bc-9da9-641a9bc435a6 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:08:13.707513 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-a34c6532-34a2-44bc-9da9-641a9bc435a6 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] 10.222.0.43 "GET /compute/v2.1/servers/4e4c90a0-14de-401e-80d5-fe4bf684d991" status: 200 len: 1406 microversion: 2.20 time: 0.164462 Jun 29 08:08:13.708076 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 297/610] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 29 08:08:13 2022] GET /compute/v2.1/servers/4e4c90a0-14de-401e-80d5-fe4bf684d991 => generated 1406 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:08:13.760453 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-682e7f63-e095-40cb-b5c4-e6666b731070 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:08:13.761110 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-682e7f63-e095-40cb-b5c4-e6666b731070 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] [instance: d7e8f0a8-6cfe-4b0e-818a-a078672dbd87] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:08:13.768442 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-682e7f63-e095-40cb-b5c4-e6666b731070 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:08:13.768894 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-682e7f63-e095-40cb-b5c4-e6666b731070 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:08:13.769742 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-682e7f63-e095-40cb-b5c4-e6666b731070 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:08:13.770187 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-682e7f63-e095-40cb-b5c4-e6666b731070 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:08:13.912768 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-682e7f63-e095-40cb-b5c4-e6666b731070 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c70c44993ab240b1a5231df4c9d550c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e0c37d941434569b3dbd07e22125210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:08:13.920296 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-682e7f63-e095-40cb-b5c4-e6666b731070 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] 10.222.0.43 "GET /compute/v2.1/servers/d7e8f0a8-6cfe-4b0e-818a-a078672dbd87" status: 200 len: 1364 microversion: 2.1 time: 0.164211 Jun 29 08:08:13.920868 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 314/611] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:08:13 2022] GET /compute/v2.1/servers/d7e8f0a8-6cfe-4b0e-818a-a078672dbd87 => generated 1364 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:08:14.726049 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-ded1175b-9c2a-4adb-875c-52b644544a2f tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:08:14.726716 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-ded1175b-9c2a-4adb-875c-52b644544a2f tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] [instance: 4e4c90a0-14de-401e-80d5-fe4bf684d991] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:08:14.728691 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG dbcounter [-] [117890] Writing DB stats nova_cell0:SELECT=2 {{(pid=117890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:08:14.729393 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG dbcounter [-] [117890] Writing DB stats nova_cell0:SELECT=12 {{(pid=117890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:08:14.737075 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-ded1175b-9c2a-4adb-875c-52b644544a2f tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:08:14.737730 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-ded1175b-9c2a-4adb-875c-52b644544a2f tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:08:14.738678 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-ded1175b-9c2a-4adb-875c-52b644544a2f tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:08:14.739535 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-ded1175b-9c2a-4adb-875c-52b644544a2f tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:08:14.902567 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-ded1175b-9c2a-4adb-875c-52b644544a2f tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:08:14.908879 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [req-d429232a-c582-4a16-80bc-c961fe5134e7 req-a7493aa1-1737-4135-8238-19535ae869e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e4c90a0-14de-401e-80d5-fe4bf684d991", "name": "network-vif-plugged", "status": "completed", "tag": "747dea80-5c60-451c-bba1-3aabe38a1272"}]} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:08:14.918577 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-ded1175b-9c2a-4adb-875c-52b644544a2f tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:08:14.921926 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-ded1175b-9c2a-4adb-875c-52b644544a2f tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:08:14.924387 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_cell0:SELECT=2 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:08:14.924651 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-ded1175b-9c2a-4adb-875c-52b644544a2f tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] 10.222.0.43 "GET /compute/v2.1/servers/4e4c90a0-14de-401e-80d5-fe4bf684d991" status: 200 len: 1406 microversion: 2.20 time: 0.202351 Jun 29 08:08:14.926014 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 298/612] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 29 08:08:14 2022] GET /compute/v2.1/servers/4e4c90a0-14de-401e-80d5-fe4bf684d991 => generated 1406 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:08:14.926774 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_cell0:SELECT=12 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:08:14.931623 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-d429232a-c582-4a16-80bc-c961fe5134e7 req-a7493aa1-1737-4135-8238-19535ae869e9 service nova] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:08:14.932318 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-d429232a-c582-4a16-80bc-c961fe5134e7 req-a7493aa1-1737-4135-8238-19535ae869e9 service nova] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:08:14.939629 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-58343d38-292f-4487-b42e-1d14cf2e0ad4 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:08:14.940250 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-58343d38-292f-4487-b42e-1d14cf2e0ad4 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] [instance: d7e8f0a8-6cfe-4b0e-818a-a078672dbd87] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:08:14.947128 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-58343d38-292f-4487-b42e-1d14cf2e0ad4 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:08:14.947579 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-58343d38-292f-4487-b42e-1d14cf2e0ad4 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:08:14.948387 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-58343d38-292f-4487-b42e-1d14cf2e0ad4 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:08:14.949013 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-58343d38-292f-4487-b42e-1d14cf2e0ad4 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:08:14.955764 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.compute.server_external_events [req-d429232a-c582-4a16-80bc-c961fe5134e7 req-a7493aa1-1737-4135-8238-19535ae869e9 service nova] Creating event network-vif-plugged:747dea80-5c60-451c-bba1-3aabe38a1272 for instance 4e4c90a0-14de-401e-80d5-fe4bf684d991 on hv-cinder-76810 Jun 29 08:08:14.965610 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [req-d429232a-c582-4a16-80bc-c961fe5134e7 req-a7493aa1-1737-4135-8238-19535ae869e9 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064722 Jun 29 08:08:14.966899 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 315/613] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jun 29 08:08:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 29 08:08:15.118833 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-58343d38-292f-4487-b42e-1d14cf2e0ad4 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c70c44993ab240b1a5231df4c9d550c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e0c37d941434569b3dbd07e22125210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:08:15.130874 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-58343d38-292f-4487-b42e-1d14cf2e0ad4 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] 10.222.0.43 "GET /compute/v2.1/servers/d7e8f0a8-6cfe-4b0e-818a-a078672dbd87" status: 200 len: 1364 microversion: 2.1 time: 0.195863 Jun 29 08:08:15.132185 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 299/614] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:08:14 2022] GET /compute/v2.1/servers/d7e8f0a8-6cfe-4b0e-818a-a078672dbd87 => generated 1364 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 08:08:15.945955 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-524b9bc5-5d3a-4baa-b2cb-5a5dc9a2fddd tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:08:15.946778 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-524b9bc5-5d3a-4baa-b2cb-5a5dc9a2fddd tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] [instance: 4e4c90a0-14de-401e-80d5-fe4bf684d991] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:08:15.955212 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-524b9bc5-5d3a-4baa-b2cb-5a5dc9a2fddd tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:08:15.955707 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-524b9bc5-5d3a-4baa-b2cb-5a5dc9a2fddd tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:08:15.956733 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-524b9bc5-5d3a-4baa-b2cb-5a5dc9a2fddd tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:08:15.957312 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-524b9bc5-5d3a-4baa-b2cb-5a5dc9a2fddd tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:08:16.101903 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-524b9bc5-5d3a-4baa-b2cb-5a5dc9a2fddd tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:08:16.112091 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-524b9bc5-5d3a-4baa-b2cb-5a5dc9a2fddd tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:08:16.113674 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-524b9bc5-5d3a-4baa-b2cb-5a5dc9a2fddd tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:08:16.114819 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-524b9bc5-5d3a-4baa-b2cb-5a5dc9a2fddd tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] 10.222.0.43 "GET /compute/v2.1/servers/4e4c90a0-14de-401e-80d5-fe4bf684d991" status: 200 len: 1406 microversion: 2.20 time: 0.173548 Jun 29 08:08:16.115384 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 316/615] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 29 08:08:15 2022] GET /compute/v2.1/servers/4e4c90a0-14de-401e-80d5-fe4bf684d991 => generated 1406 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:08:16.153918 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-d1d545a9-5574-4e26-8cbc-79748a45395f tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:08:16.154522 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-d1d545a9-5574-4e26-8cbc-79748a45395f tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] [instance: d7e8f0a8-6cfe-4b0e-818a-a078672dbd87] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:08:16.162387 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-d1d545a9-5574-4e26-8cbc-79748a45395f tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:08:16.162897 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-d1d545a9-5574-4e26-8cbc-79748a45395f tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:08:16.163736 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-d1d545a9-5574-4e26-8cbc-79748a45395f tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:08:16.164173 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-d1d545a9-5574-4e26-8cbc-79748a45395f tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:08:16.309699 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-d1d545a9-5574-4e26-8cbc-79748a45395f tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c70c44993ab240b1a5231df4c9d550c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e0c37d941434569b3dbd07e22125210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:08:16.317779 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-d1d545a9-5574-4e26-8cbc-79748a45395f tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] 10.222.0.43 "GET /compute/v2.1/servers/d7e8f0a8-6cfe-4b0e-818a-a078672dbd87" status: 200 len: 1549 microversion: 2.1 time: 0.167882 Jun 29 08:08:16.318366 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 300/616] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:08:16 2022] GET /compute/v2.1/servers/d7e8f0a8-6cfe-4b0e-818a-a078672dbd87 => generated 1549 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:08:16.335282 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-81046abb-f15b-475a-a70e-2ee47222b334 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:08:16.335772 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-81046abb-f15b-475a-a70e-2ee47222b334 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] [instance: d7e8f0a8-6cfe-4b0e-818a-a078672dbd87] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:08:16.342096 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-81046abb-f15b-475a-a70e-2ee47222b334 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:08:16.342540 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-81046abb-f15b-475a-a70e-2ee47222b334 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:08:16.343395 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-81046abb-f15b-475a-a70e-2ee47222b334 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:08:16.343831 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-81046abb-f15b-475a-a70e-2ee47222b334 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:08:16.435764 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-81046abb-f15b-475a-a70e-2ee47222b334 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] 10.222.0.43 "GET /compute/v2.1/servers/d7e8f0a8-6cfe-4b0e-818a-a078672dbd87/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.103973 Jun 29 08:08:16.436853 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 317/617] 10.222.0.43 () {58 vars in 1274 bytes} [Wed Jun 29 08:08:16 2022] GET /compute/v2.1/servers/d7e8f0a8-6cfe-4b0e-818a-a078672dbd87/os-interface => generated 284 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 29 08:08:17.137383 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-23c2e63c-6574-4db2-9027-22e6b8f9e684 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:08:17.138505 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-23c2e63c-6574-4db2-9027-22e6b8f9e684 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] [instance: 4e4c90a0-14de-401e-80d5-fe4bf684d991] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:08:17.150544 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-23c2e63c-6574-4db2-9027-22e6b8f9e684 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:08:17.151379 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-23c2e63c-6574-4db2-9027-22e6b8f9e684 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:08:17.152796 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-23c2e63c-6574-4db2-9027-22e6b8f9e684 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:08:17.153908 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-23c2e63c-6574-4db2-9027-22e6b8f9e684 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:08:17.163256 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG dbcounter [-] [117890] Writing DB stats nova_cell1:SELECT=100 {{(pid=117890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:08:17.380867 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-23c2e63c-6574-4db2-9027-22e6b8f9e684 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:08:17.389929 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-23c2e63c-6574-4db2-9027-22e6b8f9e684 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:08:17.392014 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-23c2e63c-6574-4db2-9027-22e6b8f9e684 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:08:17.393137 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-23c2e63c-6574-4db2-9027-22e6b8f9e684 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] 10.222.0.43 "GET /compute/v2.1/servers/4e4c90a0-14de-401e-80d5-fe4bf684d991" status: 200 len: 1599 microversion: 2.20 time: 0.260646 Jun 29 08:08:17.396634 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 301/618] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 29 08:08:17 2022] GET /compute/v2.1/servers/4e4c90a0-14de-401e-80d5-fe4bf684d991 => generated 1599 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:08:17.413240 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-fa4e3aed-f6c9-4130-af52-92da70a5cd47 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:08:17.413943 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-fa4e3aed-f6c9-4130-af52-92da70a5cd47 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] [instance: 4e4c90a0-14de-401e-80d5-fe4bf684d991] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:08:17.416037 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_api:SELECT=87,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:08:17.422000 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-fa4e3aed-f6c9-4130-af52-92da70a5cd47 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:08:17.422529 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-fa4e3aed-f6c9-4130-af52-92da70a5cd47 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:08:17.424088 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-fa4e3aed-f6c9-4130-af52-92da70a5cd47 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:08:17.424541 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-fa4e3aed-f6c9-4130-af52-92da70a5cd47 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:08:17.549068 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-fa4e3aed-f6c9-4130-af52-92da70a5cd47 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] 10.222.0.43 "GET /compute/v2.1/servers/4e4c90a0-14de-401e-80d5-fe4bf684d991/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.140411 Jun 29 08:08:17.549914 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 318/619] 10.222.0.43 () {60 vars in 1315 bytes} [Wed Jun 29 08:08:17 2022] GET /compute/v2.1/servers/4e4c90a0-14de-401e-80d5-fe4bf684d991/os-interface => generated 285 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 29 08:08:17.669941 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [req-eea5e250-56f7-4a18-9369-bc0dcb28b1d4 req-2eb75cdb-0bf6-48c6-a269-04880250d2ec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d7e8f0a8-6cfe-4b0e-818a-a078672dbd87", "tag": "d0e3ab57-a5ac-41d7-84d7-f243539f967b"}]} {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:08:17.686208 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [req-eea5e250-56f7-4a18-9369-bc0dcb28b1d4 req-2eb75cdb-0bf6-48c6-a269-04880250d2ec service nova] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:08:17.686996 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [req-eea5e250-56f7-4a18-9369-bc0dcb28b1d4 req-2eb75cdb-0bf6-48c6-a269-04880250d2ec service nova] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:08:17.710284 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.compute.server_external_events [req-eea5e250-56f7-4a18-9369-bc0dcb28b1d4 req-2eb75cdb-0bf6-48c6-a269-04880250d2ec service nova] Creating event network-changed:d0e3ab57-a5ac-41d7-84d7-f243539f967b for instance d7e8f0a8-6cfe-4b0e-818a-a078672dbd87 on hv-cinder-76810 Jun 29 08:08:17.719951 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [req-eea5e250-56f7-4a18-9369-bc0dcb28b1d4 req-2eb75cdb-0bf6-48c6-a269-04880250d2ec service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058400 Jun 29 08:08:17.721133 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 302/620] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jun 29 08:08:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 29 08:08:19.073964 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-4b2ed096-031c-4987-9896-aaeb5c7db611 tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-260344434"}} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:08:19.074412 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-4b2ed096-031c-4987-9896-aaeb5c7db611 tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] [instance: 4a523b7d-76fc-4f57-9bfe-c9c2b4b0b8c8] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:08:19.080696 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-4b2ed096-031c-4987-9896-aaeb5c7db611 tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:08:19.081179 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-4b2ed096-031c-4987-9896-aaeb5c7db611 tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:08:19.081967 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-4b2ed096-031c-4987-9896-aaeb5c7db611 tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:08:19.082404 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-4b2ed096-031c-4987-9896-aaeb5c7db611 tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:08:19.244605 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.network.security_group_api [None req-4b2ed096-031c-4987-9896-aaeb5c7db611 tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Removing security group e5616007-85ed-4da9-9eed-331121f2f244 from port 1315c7c2-f10d-4890-8b5e-93890c37db42 Jun 29 08:08:19.374928 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [req-7581097f-ae9b-4b39-9c19-3a15fcf5d19c req-eaade0dc-3822-42c2-92e9-79d99eca8461 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e4c90a0-14de-401e-80d5-fe4bf684d991", "tag": "747dea80-5c60-451c-bba1-3aabe38a1272"}]} {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:08:19.380288 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG dbcounter [-] [117890] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:DELETE=2,nova_api:INSERT=4 {{(pid=117890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:08:19.388544 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [req-7581097f-ae9b-4b39-9c19-3a15fcf5d19c req-eaade0dc-3822-42c2-92e9-79d99eca8461 service nova] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:08:19.389018 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [req-7581097f-ae9b-4b39-9c19-3a15fcf5d19c req-eaade0dc-3822-42c2-92e9-79d99eca8461 service nova] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:08:19.403065 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.compute.server_external_events [req-7581097f-ae9b-4b39-9c19-3a15fcf5d19c req-eaade0dc-3822-42c2-92e9-79d99eca8461 service nova] Creating event network-changed:747dea80-5c60-451c-bba1-3aabe38a1272 for instance 4e4c90a0-14de-401e-80d5-fe4bf684d991 on hv-cinder-76810 Jun 29 08:08:19.409849 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [req-7581097f-ae9b-4b39-9c19-3a15fcf5d19c req-eaade0dc-3822-42c2-92e9-79d99eca8461 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040257 Jun 29 08:08:19.410430 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 303/621] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jun 29 08:08:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 29 08:08:19.955858 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-4b2ed096-031c-4987-9896-aaeb5c7db611 tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] 10.222.0.43 "POST /compute/v2.1/servers/4a523b7d-76fc-4f57-9bfe-c9c2b4b0b8c8/action" status: 202 len: 0 microversion: 2.1 time: 0.886382 Jun 29 08:08:19.961274 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 319/622] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Jun 29 08:08:19 2022] POST /compute/v2.1/servers/4a523b7d-76fc-4f57-9bfe-c9c2b4b0b8c8/action => generated 0 bytes in 893 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 29 08:08:19.961435 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [req-530a49b2-15ab-494e-bd48-d9a8665cc82e req-c04bdcb3-4895-4b7c-a1a0-36b2727b82ab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a523b7d-76fc-4f57-9bfe-c9c2b4b0b8c8", "tag": "1315c7c2-f10d-4890-8b5e-93890c37db42"}]} {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:08:19.978866 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [req-530a49b2-15ab-494e-bd48-d9a8665cc82e req-c04bdcb3-4895-4b7c-a1a0-36b2727b82ab service nova] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:08:19.979311 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [req-530a49b2-15ab-494e-bd48-d9a8665cc82e req-c04bdcb3-4895-4b7c-a1a0-36b2727b82ab service nova] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:08:19.997945 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.compute.server_external_events [req-530a49b2-15ab-494e-bd48-d9a8665cc82e req-c04bdcb3-4895-4b7c-a1a0-36b2727b82ab service nova] Creating event network-changed:1315c7c2-f10d-4890-8b5e-93890c37db42 for instance 4a523b7d-76fc-4f57-9bfe-c9c2b4b0b8c8 on hv-cinder-76810 Jun 29 08:08:20.004189 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [req-530a49b2-15ab-494e-bd48-d9a8665cc82e req-c04bdcb3-4895-4b7c-a1a0-36b2727b82ab service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046868 Jun 29 08:08:20.004706 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 304/623] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jun 29 08:08:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 29 08:08:21.284250 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-fd6c9070-2342-43db-9a23-e981d0d0d7cd tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:08:21.284793 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-fd6c9070-2342-43db-9a23-e981d0d0d7cd tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] [instance: 4a523b7d-76fc-4f57-9bfe-c9c2b4b0b8c8] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:08:21.291012 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-fd6c9070-2342-43db-9a23-e981d0d0d7cd tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:08:21.291462 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-fd6c9070-2342-43db-9a23-e981d0d0d7cd tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:08:21.292244 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-fd6c9070-2342-43db-9a23-e981d0d0d7cd tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:08:21.292682 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-fd6c9070-2342-43db-9a23-e981d0d0d7cd tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:08:21.374012 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.objects.instance [None req-fd6c9070-2342-43db-9a23-e981d0d0d7cd tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Lazy-loading 'services' on Instance uuid 4a523b7d-76fc-4f57-9bfe-c9c2b4b0b8c8 {{(pid=117889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 29 08:08:21.457547 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-fd6c9070-2342-43db-9a23-e981d0d0d7cd tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] 10.222.0.43 "DELETE /compute/v2.1/servers/4a523b7d-76fc-4f57-9bfe-c9c2b4b0b8c8/os-volume_attachments/7363efa8-bbb9-40df-ad0d-09478e0bc426" status: 202 len: 0 microversion: 2.1 time: 0.178051 Jun 29 08:08:21.461613 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 320/624] 10.222.0.43 () {58 vars in 1415 bytes} [Wed Jun 29 08:08:21 2022] DELETE /compute/v2.1/servers/4a523b7d-76fc-4f57-9bfe-c9c2b4b0b8c8/os-volume_attachments/7363efa8-bbb9-40df-ad0d-09478e0bc426 => generated 0 bytes in 183 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 29 08:08:21.478901 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-aa1f1922-daf6-426c-8591-04832b07dcb9 tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:08:21.486244 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-aa1f1922-daf6-426c-8591-04832b07dcb9 tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] [instance: 4a523b7d-76fc-4f57-9bfe-c9c2b4b0b8c8] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:08:21.496391 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-aa1f1922-daf6-426c-8591-04832b07dcb9 tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:08:21.496842 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-aa1f1922-daf6-426c-8591-04832b07dcb9 tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:08:21.498554 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-aa1f1922-daf6-426c-8591-04832b07dcb9 tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:08:21.499783 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-aa1f1922-daf6-426c-8591-04832b07dcb9 tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:08:21.533578 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-aa1f1922-daf6-426c-8591-04832b07dcb9 tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] 10.222.0.43 "GET /compute/v2.1/servers/4a523b7d-76fc-4f57-9bfe-c9c2b4b0b8c8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.068938 Jun 29 08:08:21.534145 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 305/625] 10.222.0.43 () {58 vars in 1301 bytes} [Wed Jun 29 08:08:21 2022] GET /compute/v2.1/servers/4a523b7d-76fc-4f57-9bfe-c9c2b4b0b8c8/os-volume_attachments => generated 197 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:08:22.018623 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [req-ac354dbc-15e0-4f00-83b4-01ebed1c3b52 req-ec009491-74ea-4d28-ac17-b288417ef538 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a523b7d-76fc-4f57-9bfe-c9c2b4b0b8c8", "tag": "1315c7c2-f10d-4890-8b5e-93890c37db42"}]} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:08:22.027521 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-ac354dbc-15e0-4f00-83b4-01ebed1c3b52 req-ec009491-74ea-4d28-ac17-b288417ef538 service nova] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:08:22.027971 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-ac354dbc-15e0-4f00-83b4-01ebed1c3b52 req-ec009491-74ea-4d28-ac17-b288417ef538 service nova] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:08:22.039461 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.compute.server_external_events [req-ac354dbc-15e0-4f00-83b4-01ebed1c3b52 req-ec009491-74ea-4d28-ac17-b288417ef538 service nova] Creating event network-changed:1315c7c2-f10d-4890-8b5e-93890c37db42 for instance 4a523b7d-76fc-4f57-9bfe-c9c2b4b0b8c8 on hv-cinder-76810 Jun 29 08:08:22.044437 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [req-ac354dbc-15e0-4f00-83b4-01ebed1c3b52 req-ec009491-74ea-4d28-ac17-b288417ef538 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029988 Jun 29 08:08:22.045138 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 321/626] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jun 29 08:08:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:08:22.549977 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-c59f2556-216f-42d9-af18-321cf4bda335 tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:08:22.551851 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-c59f2556-216f-42d9-af18-321cf4bda335 tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] [instance: 4a523b7d-76fc-4f57-9bfe-c9c2b4b0b8c8] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:08:22.560192 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-c59f2556-216f-42d9-af18-321cf4bda335 tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:08:22.560646 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-c59f2556-216f-42d9-af18-321cf4bda335 tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:08:22.561472 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-c59f2556-216f-42d9-af18-321cf4bda335 tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:08:22.561906 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-c59f2556-216f-42d9-af18-321cf4bda335 tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:08:22.603328 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-c59f2556-216f-42d9-af18-321cf4bda335 tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] 10.222.0.43 "GET /compute/v2.1/servers/4a523b7d-76fc-4f57-9bfe-c9c2b4b0b8c8/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.060752 Jun 29 08:08:22.603925 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 306/627] 10.222.0.43 () {58 vars in 1301 bytes} [Wed Jun 29 08:08:22 2022] GET /compute/v2.1/servers/4a523b7d-76fc-4f57-9bfe-c9c2b4b0b8c8/os-volume_attachments => generated 25 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 29 08:08:22.614988 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-54fa5a4a-3cf5-4496-bbfc-0bc4a894d327 tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:08:22.615706 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-54fa5a4a-3cf5-4496-bbfc-0bc4a894d327 tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] [instance: 4a523b7d-76fc-4f57-9bfe-c9c2b4b0b8c8] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:08:22.622075 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-54fa5a4a-3cf5-4496-bbfc-0bc4a894d327 tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:08:22.622807 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-54fa5a4a-3cf5-4496-bbfc-0bc4a894d327 tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:08:22.623672 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-54fa5a4a-3cf5-4496-bbfc-0bc4a894d327 tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:08:22.624212 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-54fa5a4a-3cf5-4496-bbfc-0bc4a894d327 tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:08:22.713452 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.wsgi [None req-54fa5a4a-3cf5-4496-bbfc-0bc4a894d327 tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] HTTP exception thrown: Instance 4a523b7d-76fc-4f57-9bfe-c9c2b4b0b8c8 is not attached to volume 7363efa8-bbb9-40df-ad0d-09478e0bc426 Jun 29 08:08:22.715892 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-54fa5a4a-3cf5-4496-bbfc-0bc4a894d327 tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Request method failure captured: Jun 29 08:08:22.715892 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: request: DELETE /compute/v2.1/servers/4a523b7d-76fc-4f57-9bfe-c9c2b4b0b8c8/os-volume_attachments/7363efa8-bbb9-40df-ad0d-09478e0bc426 HTTP/1.1 Jun 29 08:08:22.715892 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: Accept: application/json Jun 29 08:08:22.715892 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: Accept-Encoding: identity Jun 29 08:08:22.715892 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: Connection: close Jun 29 08:08:22.715892 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: Content-Length: 0 Jun 29 08:08:22.715892 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: Content-Type: application/json Jun 29 08:08:22.715892 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: Host: 10.222.0.43 Jun 29 08:08:22.715892 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: Openstack-System-Scope: None Jun 29 08:08:22.715892 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: User-Agent: python-urllib3/1.26.9 Jun 29 08:08:22.715892 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Auth-Token: gAAAAABivAeb-y4NuBHcXXvw98cgpl0cBSXB_kKuC242p-EhJTxjtOc5J-63TQGMK4JgXdo_C83uhQFXc_fc42YY9mAzShl-YC67uPIgV3xGXLqNf2lcqNlhQdkDlWTno0CZIFpXL0ea-j00_Ymwz8a5F6EDOI2w53YbFvOhwKMhgm3sBRX_Hp4 Jun 29 08:08:22.715892 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Domain-Id: None Jun 29 08:08:22.715892 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Domain-Name: None Jun 29 08:08:22.715892 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Identity-Status: Confirmed Jun 29 08:08:22.715892 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Is-Admin-Project: True Jun 29 08:08:22.715892 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Project-Domain-Id: default Jun 29 08:08:22.715892 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Project-Domain-Name: Default Jun 29 08:08:22.715892 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Project-Id: a7afb1bdb06042f4b983631745f32e19 Jun 29 08:08:22.715892 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Project-Name: tempest-TestMinimumBasicScenario-495728199 Jun 29 08:08:22.715892 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Role: member,reader Jun 29 08:08:22.715892 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Roles: member,reader Jun 29 08:08:22.718353 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a7afb1bdb06042f4b983631745f32e19"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_a7afb1bdb06042f4b983631745f32e19"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a7afb1bdb06042f4b983631745f32e19"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/a7afb1bdb06042f4b983631745f32e19"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Jun 29 08:08:22.718353 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Tenant: tempest-TestMinimumBasicScenario-495728199 Jun 29 08:08:22.718353 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Tenant-Id: a7afb1bdb06042f4b983631745f32e19 Jun 29 08:08:22.718353 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Tenant-Name: tempest-TestMinimumBasicScenario-495728199 Jun 29 08:08:22.718353 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-User: tempest-TestMinimumBasicScenario-495728199-project Jun 29 08:08:22.718353 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-User-Domain-Id: default Jun 29 08:08:22.718353 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-User-Domain-Name: Default Jun 29 08:08:22.718353 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-User-Id: 6663857e60ca4440a9a620007be4c2c7 Jun 29 08:08:22.718353 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-User-Name: tempest-TestMinimumBasicScenario-495728199-project Jun 29 08:08:22.718353 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: method: > Jun 29 08:08:22.718353 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: exception: Instance 4a523b7d-76fc-4f57-9bfe-c9c2b4b0b8c8 is not attached to volume 7363efa8-bbb9-40df-ad0d-09478e0bc426 Jun 29 08:08:22.719880 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: action_args: {'server_id': '4a523b7d-76fc-4f57-9bfe-c9c2b4b0b8c8', 'id': '7363efa8-bbb9-40df-ad0d-09478e0bc426'} Jun 29 08:08:22.719880 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 08:08:22.719880 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:08:22.719880 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jun 29 08:08:22.719880 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jun 29 08:08:22.719880 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 29 08:08:22.719880 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 29 08:08:22.719880 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jun 29 08:08:22.719880 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jun 29 08:08:22.719880 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 7363efa8-bbb9-40df-ad0d-09478e0bc426. Jun 29 08:08:22.719880 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 29 08:08:22.719880 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 08:08:22.719880 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 29 08:08:22.719880 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:08:22.719880 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 08:08:22.719880 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 08:08:22.719880 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 08:08:22.719880 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 08:08:22.719880 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 08:08:22.721818 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 08:08:22.721818 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jun 29 08:08:22.721818 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jun 29 08:08:22.721818 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4a523b7d-76fc-4f57-9bfe-c9c2b4b0b8c8 is not attached to volume 7363efa8-bbb9-40df-ad0d-09478e0bc426 Jun 29 08:08:22.721818 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 29 08:08:22.721818 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 08:08:22.721818 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 29 08:08:22.721818 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:08:22.721818 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 08:08:22.721818 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 08:08:22.721818 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 08:08:22.721818 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 08:08:22.721818 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4a523b7d-76fc-4f57-9bfe-c9c2b4b0b8c8 is not attached to volume 7363efa8-bbb9-40df-ad0d-09478e0bc426 Jun 29 08:08:22.721818 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 29 08:08:22.721818 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-54fa5a4a-3cf5-4496-bbfc-0bc4a894d327 tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Returning 404 to user: Instance 4a523b7d-76fc-4f57-9bfe-c9c2b4b0b8c8 is not attached to volume 7363efa8-bbb9-40df-ad0d-09478e0bc426 {{(pid=117889) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 08:08:22.723026 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-54fa5a4a-3cf5-4496-bbfc-0bc4a894d327 tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] 10.222.0.43 "DELETE /compute/v2.1/servers/4a523b7d-76fc-4f57-9bfe-c9c2b4b0b8c8/os-volume_attachments/7363efa8-bbb9-40df-ad0d-09478e0bc426" status: 404 len: 154 microversion: 2.1 time: 0.107432 Jun 29 08:08:22.723026 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 322/628] 10.222.0.43 () {58 vars in 1415 bytes} [Wed Jun 29 08:08:22 2022] DELETE /compute/v2.1/servers/4a523b7d-76fc-4f57-9bfe-c9c2b4b0b8c8/os-volume_attachments/7363efa8-bbb9-40df-ad0d-09478e0bc426 => generated 154 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 29 08:08:23.860442 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-43d79191-b792-40ad-9fc8-0de34a6f9417 tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:08:23.861002 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-43d79191-b792-40ad-9fc8-0de34a6f9417 tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] [instance: 4a523b7d-76fc-4f57-9bfe-c9c2b4b0b8c8] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:08:23.867678 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-43d79191-b792-40ad-9fc8-0de34a6f9417 tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:08:23.868130 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-43d79191-b792-40ad-9fc8-0de34a6f9417 tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:08:23.868915 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-43d79191-b792-40ad-9fc8-0de34a6f9417 tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:08:23.869402 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-43d79191-b792-40ad-9fc8-0de34a6f9417 tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:08:23.895676 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-43d79191-b792-40ad-9fc8-0de34a6f9417 tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] [instance: 4a523b7d-76fc-4f57-9bfe-c9c2b4b0b8c8] Going to try to terminate instance {{(pid=117890) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 29 08:08:23.976785 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-43d79191-b792-40ad-9fc8-0de34a6f9417 tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] 10.222.0.43 "DELETE /compute/v2.1/servers/4a523b7d-76fc-4f57-9bfe-c9c2b4b0b8c8" status: 204 len: 0 microversion: 2.1 time: 0.120124 Jun 29 08:08:23.981081 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 307/629] 10.222.0.43 () {58 vars in 1238 bytes} [Wed Jun 29 08:08:23 2022] DELETE /compute/v2.1/servers/4a523b7d-76fc-4f57-9bfe-c9c2b4b0b8c8 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 29 08:08:23.986380 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-017b9c0f-c709-44cb-9ad8-217ba883c611 tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:08:23.987004 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-017b9c0f-c709-44cb-9ad8-217ba883c611 tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] [instance: 4a523b7d-76fc-4f57-9bfe-c9c2b4b0b8c8] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:08:23.996616 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-017b9c0f-c709-44cb-9ad8-217ba883c611 tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:08:23.997145 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-017b9c0f-c709-44cb-9ad8-217ba883c611 tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:08:23.998606 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-017b9c0f-c709-44cb-9ad8-217ba883c611 tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:08:23.999426 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-017b9c0f-c709-44cb-9ad8-217ba883c611 tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:08:24.141506 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-017b9c0f-c709-44cb-9ad8-217ba883c611 tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6663857e60ca4440a9a620007be4c2c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7afb1bdb06042f4b983631745f32e19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:08:24.149189 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-017b9c0f-c709-44cb-9ad8-217ba883c611 tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] 10.222.0.43 "GET /compute/v2.1/servers/4a523b7d-76fc-4f57-9bfe-c9c2b4b0b8c8" status: 200 len: 1552 microversion: 2.1 time: 0.167028 Jun 29 08:08:24.149751 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 323/630] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:08:23 2022] GET /compute/v2.1/servers/4a523b7d-76fc-4f57-9bfe-c9c2b4b0b8c8 => generated 1552 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 08:08:25.167271 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-9f4c5d14-9b06-415b-afb1-cbdb6215caf5 tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:08:25.168601 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-9f4c5d14-9b06-415b-afb1-cbdb6215caf5 tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] [instance: 4a523b7d-76fc-4f57-9bfe-c9c2b4b0b8c8] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:08:25.177506 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-9f4c5d14-9b06-415b-afb1-cbdb6215caf5 tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:08:25.178079 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-9f4c5d14-9b06-415b-afb1-cbdb6215caf5 tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:08:25.179180 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-9f4c5d14-9b06-415b-afb1-cbdb6215caf5 tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:08:25.179648 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-9f4c5d14-9b06-415b-afb1-cbdb6215caf5 tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:08:25.559339 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-9f4c5d14-9b06-415b-afb1-cbdb6215caf5 tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6663857e60ca4440a9a620007be4c2c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7afb1bdb06042f4b983631745f32e19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:08:25.568361 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-9f4c5d14-9b06-415b-afb1-cbdb6215caf5 tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] 10.222.0.43 "GET /compute/v2.1/servers/4a523b7d-76fc-4f57-9bfe-c9c2b4b0b8c8" status: 200 len: 1552 microversion: 2.1 time: 0.405250 Jun 29 08:08:25.568962 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 308/631] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:08:25 2022] GET /compute/v2.1/servers/4a523b7d-76fc-4f57-9bfe-c9c2b4b0b8c8 => generated 1552 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:08:26.154521 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-3140399f-6db0-4c4a-b4a9-2cb6efd487ce tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:08:26.155404 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-3140399f-6db0-4c4a-b4a9-2cb6efd487ce tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] [instance: ca231b38-fd3e-43ba-9cba-1de10a1ffeec] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:08:26.167312 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-3140399f-6db0-4c4a-b4a9-2cb6efd487ce tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:08:26.168122 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-3140399f-6db0-4c4a-b4a9-2cb6efd487ce tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:08:26.169373 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-3140399f-6db0-4c4a-b4a9-2cb6efd487ce tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:08:26.170098 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-3140399f-6db0-4c4a-b4a9-2cb6efd487ce tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:08:26.281936 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.objects.instance [None req-3140399f-6db0-4c4a-b4a9-2cb6efd487ce tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lazy-loading 'services' on Instance uuid ca231b38-fd3e-43ba-9cba-1de10a1ffeec {{(pid=117889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 29 08:08:26.367316 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-3140399f-6db0-4c4a-b4a9-2cb6efd487ce tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] 10.222.0.43 "DELETE /compute/v2.1/servers/ca231b38-fd3e-43ba-9cba-1de10a1ffeec/os-volume_attachments/1b642988-5e5b-4d1e-ae54-55773584effe" status: 202 len: 0 microversion: 2.1 time: 0.220613 Jun 29 08:08:26.368330 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 324/632] 10.222.0.43 () {58 vars in 1415 bytes} [Wed Jun 29 08:08:26 2022] DELETE /compute/v2.1/servers/ca231b38-fd3e-43ba-9cba-1de10a1ffeec/os-volume_attachments/1b642988-5e5b-4d1e-ae54-55773584effe => generated 0 bytes in 223 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 29 08:08:26.383723 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-9ad789e7-e4e8-4fec-977f-e4567eda19e2 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:08:26.384890 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-9ad789e7-e4e8-4fec-977f-e4567eda19e2 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] [instance: ca231b38-fd3e-43ba-9cba-1de10a1ffeec] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:08:26.393979 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-9ad789e7-e4e8-4fec-977f-e4567eda19e2 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:08:26.394609 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-9ad789e7-e4e8-4fec-977f-e4567eda19e2 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:08:26.395519 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-9ad789e7-e4e8-4fec-977f-e4567eda19e2 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:08:26.396058 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-9ad789e7-e4e8-4fec-977f-e4567eda19e2 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:08:26.435309 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-9ad789e7-e4e8-4fec-977f-e4567eda19e2 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] 10.222.0.43 "GET /compute/v2.1/servers/ca231b38-fd3e-43ba-9cba-1de10a1ffeec/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062589 Jun 29 08:08:26.440427 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 309/633] 10.222.0.43 () {58 vars in 1301 bytes} [Wed Jun 29 08:08:26 2022] GET /compute/v2.1/servers/ca231b38-fd3e-43ba-9cba-1de10a1ffeec/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:08:26.592252 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-7dbf862f-cded-4df5-943e-160f14eb8079 tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:08:26.593657 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-7dbf862f-cded-4df5-943e-160f14eb8079 tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] [instance: 4a523b7d-76fc-4f57-9bfe-c9c2b4b0b8c8] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:08:26.606289 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-7dbf862f-cded-4df5-943e-160f14eb8079 tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:08:26.607349 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-7dbf862f-cded-4df5-943e-160f14eb8079 tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:08:26.609062 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-7dbf862f-cded-4df5-943e-160f14eb8079 tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:08:26.610251 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-7dbf862f-cded-4df5-943e-160f14eb8079 tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:08:26.712933 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-7dbf862f-cded-4df5-943e-160f14eb8079 tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6663857e60ca4440a9a620007be4c2c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7afb1bdb06042f4b983631745f32e19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:08:26.724129 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-7dbf862f-cded-4df5-943e-160f14eb8079 tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] 10.222.0.43 "GET /compute/v2.1/servers/4a523b7d-76fc-4f57-9bfe-c9c2b4b0b8c8" status: 200 len: 1510 microversion: 2.1 time: 0.140710 Jun 29 08:08:26.724944 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 325/634] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:08:26 2022] GET /compute/v2.1/servers/4a523b7d-76fc-4f57-9bfe-c9c2b4b0b8c8 => generated 1510 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:08:26.792572 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [req-8d9d1ec3-8a2e-4ca3-8c77-3f562f7c0b97 req-74299afa-7ef8-4060-a86f-c09c5d0d105f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a523b7d-76fc-4f57-9bfe-c9c2b4b0b8c8", "name": "network-vif-deleted", "tag": "1315c7c2-f10d-4890-8b5e-93890c37db42"}]} {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:08:26.801189 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [req-8d9d1ec3-8a2e-4ca3-8c77-3f562f7c0b97 req-74299afa-7ef8-4060-a86f-c09c5d0d105f service nova] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:08:26.801631 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [req-8d9d1ec3-8a2e-4ca3-8c77-3f562f7c0b97 req-74299afa-7ef8-4060-a86f-c09c5d0d105f service nova] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:08:26.813202 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.compute.server_external_events [req-8d9d1ec3-8a2e-4ca3-8c77-3f562f7c0b97 req-74299afa-7ef8-4060-a86f-c09c5d0d105f service nova] Creating event network-vif-deleted:1315c7c2-f10d-4890-8b5e-93890c37db42 for instance 4a523b7d-76fc-4f57-9bfe-c9c2b4b0b8c8 on hv-cinder-76810 Jun 29 08:08:26.818117 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [req-8d9d1ec3-8a2e-4ca3-8c77-3f562f7c0b97 req-74299afa-7ef8-4060-a86f-c09c5d0d105f service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087358 Jun 29 08:08:26.818713 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 310/635] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jun 29 08:08:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 29 08:08:27.448296 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-0f323fcc-8774-4fbb-85ec-7c6d99b15dc9 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:08:27.449643 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-0f323fcc-8774-4fbb-85ec-7c6d99b15dc9 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] [instance: ca231b38-fd3e-43ba-9cba-1de10a1ffeec] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:08:27.458357 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-0f323fcc-8774-4fbb-85ec-7c6d99b15dc9 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:08:27.458809 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-0f323fcc-8774-4fbb-85ec-7c6d99b15dc9 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:08:27.459788 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-0f323fcc-8774-4fbb-85ec-7c6d99b15dc9 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:08:27.460230 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-0f323fcc-8774-4fbb-85ec-7c6d99b15dc9 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:08:27.496626 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-0f323fcc-8774-4fbb-85ec-7c6d99b15dc9 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] 10.222.0.43 "GET /compute/v2.1/servers/ca231b38-fd3e-43ba-9cba-1de10a1ffeec/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.052322 Jun 29 08:08:27.497893 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 326/636] 10.222.0.43 () {58 vars in 1301 bytes} [Wed Jun 29 08:08:27 2022] GET /compute/v2.1/servers/ca231b38-fd3e-43ba-9cba-1de10a1ffeec/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 29 08:08:27.604861 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-6a57f00b-1818-4737-bfa8-a4347c0992a0 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:08:27.606285 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-6a57f00b-1818-4737-bfa8-a4347c0992a0 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] [instance: ca231b38-fd3e-43ba-9cba-1de10a1ffeec] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:08:27.617794 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-6a57f00b-1818-4737-bfa8-a4347c0992a0 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:08:27.618577 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-6a57f00b-1818-4737-bfa8-a4347c0992a0 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:08:27.619962 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-6a57f00b-1818-4737-bfa8-a4347c0992a0 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:08:27.620774 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-6a57f00b-1818-4737-bfa8-a4347c0992a0 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:08:27.652393 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-6a57f00b-1818-4737-bfa8-a4347c0992a0 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] [instance: ca231b38-fd3e-43ba-9cba-1de10a1ffeec] Going to try to terminate instance {{(pid=117890) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 29 08:08:27.736853 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-6a57f00b-1818-4737-bfa8-a4347c0992a0 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] 10.222.0.43 "DELETE /compute/v2.1/servers/ca231b38-fd3e-43ba-9cba-1de10a1ffeec" status: 204 len: 0 microversion: 2.1 time: 0.137692 Jun 29 08:08:27.737827 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 311/637] 10.222.0.43 () {58 vars in 1238 bytes} [Wed Jun 29 08:08:27 2022] DELETE /compute/v2.1/servers/ca231b38-fd3e-43ba-9cba-1de10a1ffeec => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 29 08:08:27.747053 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-5a559a45-8f85-4cb2-8e24-a0f8f2bfa742 tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:08:27.748408 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-6b75b127-610a-495a-ad16-08edd9e7768c tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:08:27.748546 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-5a559a45-8f85-4cb2-8e24-a0f8f2bfa742 tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] [instance: 4a523b7d-76fc-4f57-9bfe-c9c2b4b0b8c8] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:08:27.749214 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-6b75b127-610a-495a-ad16-08edd9e7768c tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] [instance: ca231b38-fd3e-43ba-9cba-1de10a1ffeec] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:08:27.757414 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-6b75b127-610a-495a-ad16-08edd9e7768c tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:08:27.757905 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-6b75b127-610a-495a-ad16-08edd9e7768c tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:08:27.758715 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-6b75b127-610a-495a-ad16-08edd9e7768c tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:08:27.758943 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-5a559a45-8f85-4cb2-8e24-a0f8f2bfa742 tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:08:27.759147 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-6b75b127-610a-495a-ad16-08edd9e7768c tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:08:27.759689 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-5a559a45-8f85-4cb2-8e24-a0f8f2bfa742 tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:08:27.760674 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-5a559a45-8f85-4cb2-8e24-a0f8f2bfa742 tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:08:27.761298 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-5a559a45-8f85-4cb2-8e24-a0f8f2bfa742 tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:08:27.780171 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.wsgi [None req-5a559a45-8f85-4cb2-8e24-a0f8f2bfa742 tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] HTTP exception thrown: Instance 4a523b7d-76fc-4f57-9bfe-c9c2b4b0b8c8 could not be found. Jun 29 08:08:27.782486 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-5a559a45-8f85-4cb2-8e24-a0f8f2bfa742 tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Request method failure captured: Jun 29 08:08:27.782486 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: request: GET /compute/v2.1/servers/4a523b7d-76fc-4f57-9bfe-c9c2b4b0b8c8 HTTP/1.1 Jun 29 08:08:27.782486 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: Accept: application/json Jun 29 08:08:27.782486 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: Accept-Encoding: identity Jun 29 08:08:27.782486 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: Connection: close Jun 29 08:08:27.782486 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: Content-Length: 0 Jun 29 08:08:27.782486 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: Content-Type: application/json Jun 29 08:08:27.782486 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: Host: 10.222.0.43 Jun 29 08:08:27.782486 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: Openstack-System-Scope: None Jun 29 08:08:27.782486 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: User-Agent: python-urllib3/1.26.9 Jun 29 08:08:27.782486 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Auth-Token: gAAAAABivAeb-y4NuBHcXXvw98cgpl0cBSXB_kKuC242p-EhJTxjtOc5J-63TQGMK4JgXdo_C83uhQFXc_fc42YY9mAzShl-YC67uPIgV3xGXLqNf2lcqNlhQdkDlWTno0CZIFpXL0ea-j00_Ymwz8a5F6EDOI2w53YbFvOhwKMhgm3sBRX_Hp4 Jun 29 08:08:27.782486 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Domain-Id: None Jun 29 08:08:27.782486 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Domain-Name: None Jun 29 08:08:27.782486 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Identity-Status: Confirmed Jun 29 08:08:27.782486 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Is-Admin-Project: True Jun 29 08:08:27.782486 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Project-Domain-Id: default Jun 29 08:08:27.782486 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Project-Domain-Name: Default Jun 29 08:08:27.782486 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Project-Id: a7afb1bdb06042f4b983631745f32e19 Jun 29 08:08:27.782486 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Project-Name: tempest-TestMinimumBasicScenario-495728199 Jun 29 08:08:27.782486 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Role: member,reader Jun 29 08:08:27.782486 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Roles: member,reader Jun 29 08:08:27.783937 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a7afb1bdb06042f4b983631745f32e19"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_a7afb1bdb06042f4b983631745f32e19"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a7afb1bdb06042f4b983631745f32e19"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/a7afb1bdb06042f4b983631745f32e19"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Jun 29 08:08:27.783937 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Tenant: tempest-TestMinimumBasicScenario-495728199 Jun 29 08:08:27.783937 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Tenant-Id: a7afb1bdb06042f4b983631745f32e19 Jun 29 08:08:27.783937 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Tenant-Name: tempest-TestMinimumBasicScenario-495728199 Jun 29 08:08:27.783937 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-User: tempest-TestMinimumBasicScenario-495728199-project Jun 29 08:08:27.783937 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-User-Domain-Id: default Jun 29 08:08:27.783937 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-User-Domain-Name: Default Jun 29 08:08:27.783937 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-User-Id: 6663857e60ca4440a9a620007be4c2c7 Jun 29 08:08:27.783937 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-User-Name: tempest-TestMinimumBasicScenario-495728199-project Jun 29 08:08:27.783937 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: method: > Jun 29 08:08:27.783937 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: exception: Instance 4a523b7d-76fc-4f57-9bfe-c9c2b4b0b8c8 could not be found. Jun 29 08:08:27.783937 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: action_args: {'id': '4a523b7d-76fc-4f57-9bfe-c9c2b4b0b8c8'} Jun 29 08:08:27.784649 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 08:08:27.784649 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:08:27.784649 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 29 08:08:27.784649 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 29 08:08:27.784649 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 29 08:08:27.784649 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 29 08:08:27.784649 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 29 08:08:27.784649 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 29 08:08:27.784649 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 29 08:08:27.784649 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 29 08:08:27.784649 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4a523b7d-76fc-4f57-9bfe-c9c2b4b0b8c8 could not be found. Jun 29 08:08:27.784649 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 29 08:08:27.784649 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 08:08:27.784649 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 29 08:08:27.784649 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:08:27.784649 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 08:08:27.784649 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 08:08:27.784649 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 08:08:27.784649 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 08:08:27.784649 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 08:08:27.786262 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 08:08:27.786262 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 29 08:08:27.786262 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 29 08:08:27.786262 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 29 08:08:27.786262 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 29 08:08:27.786262 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 29 08:08:27.786262 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 29 08:08:27.786262 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4a523b7d-76fc-4f57-9bfe-c9c2b4b0b8c8 could not be found. Jun 29 08:08:27.786262 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 29 08:08:27.786262 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 08:08:27.786262 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 29 08:08:27.786262 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:08:27.786262 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 08:08:27.786262 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 08:08:27.786262 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 08:08:27.786262 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 08:08:27.786262 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4a523b7d-76fc-4f57-9bfe-c9c2b4b0b8c8 could not be found. Jun 29 08:08:27.786262 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 29 08:08:27.787339 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-5a559a45-8f85-4cb2-8e24-a0f8f2bfa742 tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Returning 404 to user: Instance 4a523b7d-76fc-4f57-9bfe-c9c2b4b0b8c8 could not be found. {{(pid=117889) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 08:08:27.787339 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-5a559a45-8f85-4cb2-8e24-a0f8f2bfa742 tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] 10.222.0.43 "GET /compute/v2.1/servers/4a523b7d-76fc-4f57-9bfe-c9c2b4b0b8c8" status: 404 len: 111 microversion: 2.1 time: 0.044148 Jun 29 08:08:27.787339 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 327/638] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:08:27 2022] GET /compute/v2.1/servers/4a523b7d-76fc-4f57-9bfe-c9c2b4b0b8c8 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 29 08:08:27.792945 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-7bd67ac0-8c1b-4644-a9b1-6da2f133594c tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] Calling method '.version_select at 0x7f7241298700>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:08:27.814264 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-7bd67ac0-8c1b-4644-a9b1-6da2f133594c tempest-TestMinimumBasicScenario-495728199 tempest-TestMinimumBasicScenario-495728199-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-721615885" status: 202 len: 0 microversion: 2.1 time: 0.025065 Jun 29 08:08:27.814855 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 328/639] 10.222.0.43 () {58 vars in 1268 bytes} [Wed Jun 29 08:08:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-721615885 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 29 08:08:27.930249 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-6b75b127-610a-495a-ad16-08edd9e7768c tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4af4eedee24897be2e702ef51873b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab693125979f4bb7b7b3c94061610fe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:08:27.938662 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-6b75b127-610a-495a-ad16-08edd9e7768c tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] 10.222.0.43 "GET /compute/v2.1/servers/ca231b38-fd3e-43ba-9cba-1de10a1ffeec" status: 200 len: 1688 microversion: 2.1 time: 0.194603 Jun 29 08:08:27.939263 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 312/640] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:08:27 2022] GET /compute/v2.1/servers/ca231b38-fd3e-43ba-9cba-1de10a1ffeec => generated 1688 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 08:08:28.956446 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-64215a1a-15be-4c36-b49f-c0a36015455b tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:08:28.957154 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-64215a1a-15be-4c36-b49f-c0a36015455b tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] [instance: ca231b38-fd3e-43ba-9cba-1de10a1ffeec] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:08:28.964560 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-64215a1a-15be-4c36-b49f-c0a36015455b tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:08:28.965044 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-64215a1a-15be-4c36-b49f-c0a36015455b tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:08:28.965836 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-64215a1a-15be-4c36-b49f-c0a36015455b tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:08:28.966289 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-64215a1a-15be-4c36-b49f-c0a36015455b tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:08:29.112781 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-64215a1a-15be-4c36-b49f-c0a36015455b tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4af4eedee24897be2e702ef51873b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab693125979f4bb7b7b3c94061610fe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:08:29.121530 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-64215a1a-15be-4c36-b49f-c0a36015455b tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] 10.222.0.43 "GET /compute/v2.1/servers/ca231b38-fd3e-43ba-9cba-1de10a1ffeec" status: 200 len: 1688 microversion: 2.1 time: 0.169529 Jun 29 08:08:29.122219 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 329/641] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:08:28 2022] GET /compute/v2.1/servers/ca231b38-fd3e-43ba-9cba-1de10a1ffeec => generated 1688 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:08:30.144215 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-83ca18a6-ad75-4383-b755-1e54c8abaacf tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:08:30.144935 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-83ca18a6-ad75-4383-b755-1e54c8abaacf tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] [instance: ca231b38-fd3e-43ba-9cba-1de10a1ffeec] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:08:30.152158 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-83ca18a6-ad75-4383-b755-1e54c8abaacf tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:08:30.152614 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-83ca18a6-ad75-4383-b755-1e54c8abaacf tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:08:30.153915 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-83ca18a6-ad75-4383-b755-1e54c8abaacf tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:08:30.153915 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-83ca18a6-ad75-4383-b755-1e54c8abaacf tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:08:30.318862 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-83ca18a6-ad75-4383-b755-1e54c8abaacf tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4af4eedee24897be2e702ef51873b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab693125979f4bb7b7b3c94061610fe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:08:30.327969 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-83ca18a6-ad75-4383-b755-1e54c8abaacf tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] 10.222.0.43 "GET /compute/v2.1/servers/ca231b38-fd3e-43ba-9cba-1de10a1ffeec" status: 200 len: 1688 microversion: 2.1 time: 0.189184 Jun 29 08:08:30.333108 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 313/642] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:08:30 2022] GET /compute/v2.1/servers/ca231b38-fd3e-43ba-9cba-1de10a1ffeec => generated 1688 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:08:31.347909 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-66944d1e-520a-4dc9-b8b1-2d149f06b152 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:08:31.348755 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-66944d1e-520a-4dc9-b8b1-2d149f06b152 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] [instance: ca231b38-fd3e-43ba-9cba-1de10a1ffeec] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:08:31.357654 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-66944d1e-520a-4dc9-b8b1-2d149f06b152 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:08:31.358239 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-66944d1e-520a-4dc9-b8b1-2d149f06b152 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:08:31.359437 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-66944d1e-520a-4dc9-b8b1-2d149f06b152 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:08:31.360121 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-66944d1e-520a-4dc9-b8b1-2d149f06b152 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:08:31.635425 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-66944d1e-520a-4dc9-b8b1-2d149f06b152 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4af4eedee24897be2e702ef51873b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab693125979f4bb7b7b3c94061610fe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:08:31.644775 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-66944d1e-520a-4dc9-b8b1-2d149f06b152 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] 10.222.0.43 "GET /compute/v2.1/servers/ca231b38-fd3e-43ba-9cba-1de10a1ffeec" status: 200 len: 1688 microversion: 2.1 time: 0.302439 Jun 29 08:08:31.653127 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 330/643] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:08:31 2022] GET /compute/v2.1/servers/ca231b38-fd3e-43ba-9cba-1de10a1ffeec => generated 1688 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:08:32.667954 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-f867c358-de81-4ea8-9c7c-86ec2f36d972 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:08:32.668598 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-f867c358-de81-4ea8-9c7c-86ec2f36d972 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] [instance: ca231b38-fd3e-43ba-9cba-1de10a1ffeec] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:08:32.676455 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-f867c358-de81-4ea8-9c7c-86ec2f36d972 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:08:32.676915 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-f867c358-de81-4ea8-9c7c-86ec2f36d972 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:08:32.677734 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-f867c358-de81-4ea8-9c7c-86ec2f36d972 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:08:32.678184 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-f867c358-de81-4ea8-9c7c-86ec2f36d972 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:08:33.050319 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-f867c358-de81-4ea8-9c7c-86ec2f36d972 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4af4eedee24897be2e702ef51873b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab693125979f4bb7b7b3c94061610fe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:08:33.071103 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-f867c358-de81-4ea8-9c7c-86ec2f36d972 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] 10.222.0.43 "GET /compute/v2.1/servers/ca231b38-fd3e-43ba-9cba-1de10a1ffeec" status: 200 len: 1688 microversion: 2.1 time: 0.407050 Jun 29 08:08:33.071768 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 314/644] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:08:32 2022] GET /compute/v2.1/servers/ca231b38-fd3e-43ba-9cba-1de10a1ffeec => generated 1688 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:08:33.381824 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [req-1bbae1e8-cb66-4802-9239-cab9e9aff409 req-93735d94-087d-49a0-b32b-dac6283bb0d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca231b38-fd3e-43ba-9cba-1de10a1ffeec", "name": "network-vif-deleted", "tag": "5a5ce414-6f70-43b5-a7cc-7340f679070a"}]} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:08:33.401450 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-1bbae1e8-cb66-4802-9239-cab9e9aff409 req-93735d94-087d-49a0-b32b-dac6283bb0d7 service nova] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:08:33.402687 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-1bbae1e8-cb66-4802-9239-cab9e9aff409 req-93735d94-087d-49a0-b32b-dac6283bb0d7 service nova] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:08:33.424406 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.compute.server_external_events [req-1bbae1e8-cb66-4802-9239-cab9e9aff409 req-93735d94-087d-49a0-b32b-dac6283bb0d7 service nova] Creating event network-vif-deleted:5a5ce414-6f70-43b5-a7cc-7340f679070a for instance ca231b38-fd3e-43ba-9cba-1de10a1ffeec on hv-cinder-76810 Jun 29 08:08:33.435180 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [req-1bbae1e8-cb66-4802-9239-cab9e9aff409 req-93735d94-087d-49a0-b32b-dac6283bb0d7 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056239 Jun 29 08:08:33.436759 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 331/645] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jun 29 08:08:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 29 08:08:34.106147 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-bf4dc9f4-cff9-41cb-9662-338e8f94128b tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:08:34.108766 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-bf4dc9f4-cff9-41cb-9662-338e8f94128b tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] [instance: ca231b38-fd3e-43ba-9cba-1de10a1ffeec] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:08:34.131252 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-bf4dc9f4-cff9-41cb-9662-338e8f94128b tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:08:34.139413 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-bf4dc9f4-cff9-41cb-9662-338e8f94128b tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:08:34.141608 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-bf4dc9f4-cff9-41cb-9662-338e8f94128b tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:08:34.142776 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-bf4dc9f4-cff9-41cb-9662-338e8f94128b tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:08:34.169094 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.wsgi [None req-bf4dc9f4-cff9-41cb-9662-338e8f94128b tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] HTTP exception thrown: Instance ca231b38-fd3e-43ba-9cba-1de10a1ffeec could not be found. Jun 29 08:08:34.173557 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-bf4dc9f4-cff9-41cb-9662-338e8f94128b tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Request method failure captured: Jun 29 08:08:34.173557 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: request: GET /compute/v2.1/servers/ca231b38-fd3e-43ba-9cba-1de10a1ffeec HTTP/1.1 Jun 29 08:08:34.173557 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: Accept: application/json Jun 29 08:08:34.173557 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: Accept-Encoding: identity Jun 29 08:08:34.173557 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: Connection: close Jun 29 08:08:34.173557 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: Content-Length: 0 Jun 29 08:08:34.173557 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: Content-Type: application/json Jun 29 08:08:34.173557 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: Host: 10.222.0.43 Jun 29 08:08:34.173557 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: Openstack-System-Scope: None Jun 29 08:08:34.173557 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: User-Agent: python-urllib3/1.26.9 Jun 29 08:08:34.173557 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Auth-Token: gAAAAABivAcrRGv8n-hBTzbO-mvdA9ZuWTSzlFAkKkndDN8FN_iXGvsZd7rjQm_nN6TZnE7JfsJp8_xcKjzwxgIiNSK_dDCsCpCeOaZ_u5KXcRULb_0_OxKetSiSEtrbxD9wcdC3B0H-F_SoNZ4yDrjB8_rwxeM6bFtzhz_78UcZZraaffHkiVk Jun 29 08:08:34.173557 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Domain-Id: None Jun 29 08:08:34.173557 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Domain-Name: None Jun 29 08:08:34.173557 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Identity-Status: Confirmed Jun 29 08:08:34.173557 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Is-Admin-Project: True Jun 29 08:08:34.173557 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Project-Domain-Id: default Jun 29 08:08:34.173557 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Project-Domain-Name: Default Jun 29 08:08:34.173557 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Project-Id: ab693125979f4bb7b7b3c94061610fe2 Jun 29 08:08:34.173557 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-796076534 Jun 29 08:08:34.173557 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Role: member,reader Jun 29 08:08:34.173557 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Roles: member,reader Jun 29 08:08:34.176826 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/ab693125979f4bb7b7b3c94061610fe2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_ab693125979f4bb7b7b3c94061610fe2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/ab693125979f4bb7b7b3c94061610fe2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/ab693125979f4bb7b7b3c94061610fe2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Jun 29 08:08:34.176826 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Tenant: tempest-ServerRescueNegativeTestJSON-796076534 Jun 29 08:08:34.176826 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Tenant-Id: ab693125979f4bb7b7b3c94061610fe2 Jun 29 08:08:34.176826 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-796076534 Jun 29 08:08:34.176826 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-User: tempest-ServerRescueNegativeTestJSON-796076534-project Jun 29 08:08:34.176826 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-User-Domain-Id: default Jun 29 08:08:34.176826 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-User-Domain-Name: Default Jun 29 08:08:34.176826 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-User-Id: 1f4af4eedee24897be2e702ef51873b3 Jun 29 08:08:34.176826 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-User-Name: tempest-ServerRescueNegativeTestJSON-796076534-project Jun 29 08:08:34.176826 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: method: > Jun 29 08:08:34.176826 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: exception: Instance ca231b38-fd3e-43ba-9cba-1de10a1ffeec could not be found. Jun 29 08:08:34.176826 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: action_args: {'id': 'ca231b38-fd3e-43ba-9cba-1de10a1ffeec'} Jun 29 08:08:34.178300 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 08:08:34.178300 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:08:34.178300 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 29 08:08:34.178300 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 29 08:08:34.178300 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 29 08:08:34.178300 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 29 08:08:34.178300 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 29 08:08:34.178300 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 29 08:08:34.178300 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 29 08:08:34.178300 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 29 08:08:34.178300 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ca231b38-fd3e-43ba-9cba-1de10a1ffeec could not be found. Jun 29 08:08:34.178300 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 29 08:08:34.178300 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 08:08:34.178300 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 29 08:08:34.178300 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:08:34.178300 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 08:08:34.178300 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 08:08:34.178300 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 08:08:34.178300 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 08:08:34.178300 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 08:08:34.184590 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 08:08:34.184590 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 29 08:08:34.184590 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 29 08:08:34.184590 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 29 08:08:34.184590 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 29 08:08:34.184590 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 29 08:08:34.184590 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 29 08:08:34.184590 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ca231b38-fd3e-43ba-9cba-1de10a1ffeec could not be found. Jun 29 08:08:34.184590 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 29 08:08:34.184590 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 08:08:34.184590 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 29 08:08:34.184590 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:08:34.184590 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 08:08:34.184590 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 08:08:34.184590 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 08:08:34.184590 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 08:08:34.184590 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ca231b38-fd3e-43ba-9cba-1de10a1ffeec could not be found. Jun 29 08:08:34.184590 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 29 08:08:34.189991 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-bf4dc9f4-cff9-41cb-9662-338e8f94128b tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Returning 404 to user: Instance ca231b38-fd3e-43ba-9cba-1de10a1ffeec could not be found. {{(pid=117890) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 08:08:34.191797 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-bf4dc9f4-cff9-41cb-9662-338e8f94128b tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] 10.222.0.43 "GET /compute/v2.1/servers/ca231b38-fd3e-43ba-9cba-1de10a1ffeec" status: 404 len: 111 microversion: 2.1 time: 0.093139 Jun 29 08:08:34.192752 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 315/646] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:08:34 2022] GET /compute/v2.1/servers/ca231b38-fd3e-43ba-9cba-1de10a1ffeec => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 29 08:08:34.209614 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-48b25a95-741d-4b93-a1f7-3bb36575d937 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Calling method '.version_select at 0x7f7241200f70>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:08:34.247899 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-48b25a95-741d-4b93-a1f7-3bb36575d937 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-717086815" status: 202 len: 0 microversion: 2.1 time: 0.047419 Jun 29 08:08:34.249424 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 332/647] 10.222.0.43 () {58 vars in 1217 bytes} [Wed Jun 29 08:08:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-717086815 => generated 0 bytes in 51 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 29 08:08:37.456008 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-8ccd672c-e925-4aee-aea0-36f1a746d51b tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:08:37.457315 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-8ccd672c-e925-4aee-aea0-36f1a746d51b tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] [instance: 4f1bbb36-8695-4b09-9f25-bfc92ad06a86] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:08:37.470205 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-8ccd672c-e925-4aee-aea0-36f1a746d51b tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:08:37.471675 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-8ccd672c-e925-4aee-aea0-36f1a746d51b tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:08:37.473209 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-8ccd672c-e925-4aee-aea0-36f1a746d51b tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:08:37.473979 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-8ccd672c-e925-4aee-aea0-36f1a746d51b tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:08:37.505317 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-8ccd672c-e925-4aee-aea0-36f1a746d51b tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] [instance: 4f1bbb36-8695-4b09-9f25-bfc92ad06a86] Going to try to terminate instance {{(pid=117890) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 29 08:08:37.557118 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG dbcounter [-] [117890] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:08:37.619609 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-8ccd672c-e925-4aee-aea0-36f1a746d51b tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] 10.222.0.43 "DELETE /compute/v2.1/servers/4f1bbb36-8695-4b09-9f25-bfc92ad06a86" status: 204 len: 0 microversion: 2.1 time: 0.170922 Jun 29 08:08:37.620615 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 316/648] 10.222.0.43 () {58 vars in 1238 bytes} [Wed Jun 29 08:08:37 2022] DELETE /compute/v2.1/servers/4f1bbb36-8695-4b09-9f25-bfc92ad06a86 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 29 08:08:37.630753 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-92b03fdf-b7c4-4d92-9e90-4b3a27ee213a tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:08:37.631857 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-92b03fdf-b7c4-4d92-9e90-4b3a27ee213a tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] [instance: 4f1bbb36-8695-4b09-9f25-bfc92ad06a86] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:08:37.638532 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-92b03fdf-b7c4-4d92-9e90-4b3a27ee213a tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:08:37.638994 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-92b03fdf-b7c4-4d92-9e90-4b3a27ee213a tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:08:37.639827 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-92b03fdf-b7c4-4d92-9e90-4b3a27ee213a tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:08:37.641186 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-92b03fdf-b7c4-4d92-9e90-4b3a27ee213a tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:08:37.662580 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=2 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:08:37.842209 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-92b03fdf-b7c4-4d92-9e90-4b3a27ee213a tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4af4eedee24897be2e702ef51873b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab693125979f4bb7b7b3c94061610fe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:08:37.852483 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-92b03fdf-b7c4-4d92-9e90-4b3a27ee213a tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] 10.222.0.43 "GET /compute/v2.1/servers/4f1bbb36-8695-4b09-9f25-bfc92ad06a86" status: 200 len: 1505 microversion: 2.1 time: 0.226640 Jun 29 08:08:37.853237 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 333/649] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:08:37 2022] GET /compute/v2.1/servers/4f1bbb36-8695-4b09-9f25-bfc92ad06a86 => generated 1505 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 08:08:38.879796 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-ef3e5e1c-15a5-4a90-a039-b63533b1be5d tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:08:38.881332 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-ef3e5e1c-15a5-4a90-a039-b63533b1be5d tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] [instance: 4f1bbb36-8695-4b09-9f25-bfc92ad06a86] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:08:38.893777 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-ef3e5e1c-15a5-4a90-a039-b63533b1be5d tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:08:38.894536 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-ef3e5e1c-15a5-4a90-a039-b63533b1be5d tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:08:38.895947 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-ef3e5e1c-15a5-4a90-a039-b63533b1be5d tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:08:38.896661 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-ef3e5e1c-15a5-4a90-a039-b63533b1be5d tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:08:39.110970 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-ef3e5e1c-15a5-4a90-a039-b63533b1be5d tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4af4eedee24897be2e702ef51873b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab693125979f4bb7b7b3c94061610fe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:08:39.120155 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-ef3e5e1c-15a5-4a90-a039-b63533b1be5d tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] 10.222.0.43 "GET /compute/v2.1/servers/4f1bbb36-8695-4b09-9f25-bfc92ad06a86" status: 200 len: 1505 microversion: 2.1 time: 0.245865 Jun 29 08:08:39.120882 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 317/650] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:08:38 2022] GET /compute/v2.1/servers/4f1bbb36-8695-4b09-9f25-bfc92ad06a86 => generated 1505 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:08:40.143895 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-c7df46a0-b78f-4fd5-9cd0-482cd30dce86 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:08:40.145333 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-c7df46a0-b78f-4fd5-9cd0-482cd30dce86 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] [instance: 4f1bbb36-8695-4b09-9f25-bfc92ad06a86] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:08:40.146175 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [req-fb66c691-04b0-4327-88ae-f396812708aa req-94644124-c50e-4b31-a52c-a722b518d707 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f1bbb36-8695-4b09-9f25-bfc92ad06a86", "name": "network-vif-deleted", "tag": "e221748f-d034-48b4-8150-5e3a269027a4"}]} {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:08:40.153903 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c7df46a0-b78f-4fd5-9cd0-482cd30dce86 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:08:40.154667 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c7df46a0-b78f-4fd5-9cd0-482cd30dce86 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:08:40.156352 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c7df46a0-b78f-4fd5-9cd0-482cd30dce86 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:08:40.156842 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c7df46a0-b78f-4fd5-9cd0-482cd30dce86 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:08:40.159650 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [req-fb66c691-04b0-4327-88ae-f396812708aa req-94644124-c50e-4b31-a52c-a722b518d707 service nova] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:08:40.161137 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [req-fb66c691-04b0-4327-88ae-f396812708aa req-94644124-c50e-4b31-a52c-a722b518d707 service nova] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:08:40.182042 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.compute.server_external_events [req-fb66c691-04b0-4327-88ae-f396812708aa req-94644124-c50e-4b31-a52c-a722b518d707 service nova] Creating event network-vif-deleted:e221748f-d034-48b4-8150-5e3a269027a4 for instance 4f1bbb36-8695-4b09-9f25-bfc92ad06a86 on hv-cinder-76810 Jun 29 08:08:40.189582 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [req-fb66c691-04b0-4327-88ae-f396812708aa req-94644124-c50e-4b31-a52c-a722b518d707 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051868 Jun 29 08:08:40.190778 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 318/651] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jun 29 08:08:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:08:40.235394 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-c7df46a0-b78f-4fd5-9cd0-482cd30dce86 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4af4eedee24897be2e702ef51873b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab693125979f4bb7b7b3c94061610fe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:08:40.243312 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-c7df46a0-b78f-4fd5-9cd0-482cd30dce86 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] 10.222.0.43 "GET /compute/v2.1/servers/4f1bbb36-8695-4b09-9f25-bfc92ad06a86" status: 200 len: 1463 microversion: 2.1 time: 0.106603 Jun 29 08:08:40.243997 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 334/652] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:08:40 2022] GET /compute/v2.1/servers/4f1bbb36-8695-4b09-9f25-bfc92ad06a86 => generated 1463 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:08:41.262788 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-5666f48d-8017-42ed-903e-27d34f86ec63 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:08:41.263506 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-5666f48d-8017-42ed-903e-27d34f86ec63 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] [instance: 4f1bbb36-8695-4b09-9f25-bfc92ad06a86] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:08:41.270298 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-5666f48d-8017-42ed-903e-27d34f86ec63 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:08:41.270743 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-5666f48d-8017-42ed-903e-27d34f86ec63 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:08:41.271514 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-5666f48d-8017-42ed-903e-27d34f86ec63 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:08:41.271945 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-5666f48d-8017-42ed-903e-27d34f86ec63 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:08:41.291688 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.wsgi [None req-5666f48d-8017-42ed-903e-27d34f86ec63 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] HTTP exception thrown: Instance 4f1bbb36-8695-4b09-9f25-bfc92ad06a86 could not be found. Jun 29 08:08:41.293409 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-5666f48d-8017-42ed-903e-27d34f86ec63 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Request method failure captured: Jun 29 08:08:41.293409 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: request: GET /compute/v2.1/servers/4f1bbb36-8695-4b09-9f25-bfc92ad06a86 HTTP/1.1 Jun 29 08:08:41.293409 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: Accept: application/json Jun 29 08:08:41.293409 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: Accept-Encoding: identity Jun 29 08:08:41.293409 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: Connection: close Jun 29 08:08:41.293409 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: Content-Length: 0 Jun 29 08:08:41.293409 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: Content-Type: application/json Jun 29 08:08:41.293409 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: Host: 10.222.0.43 Jun 29 08:08:41.293409 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: Openstack-System-Scope: None Jun 29 08:08:41.293409 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: User-Agent: python-urllib3/1.26.9 Jun 29 08:08:41.293409 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Auth-Token: gAAAAABivAcrRGv8n-hBTzbO-mvdA9ZuWTSzlFAkKkndDN8FN_iXGvsZd7rjQm_nN6TZnE7JfsJp8_xcKjzwxgIiNSK_dDCsCpCeOaZ_u5KXcRULb_0_OxKetSiSEtrbxD9wcdC3B0H-F_SoNZ4yDrjB8_rwxeM6bFtzhz_78UcZZraaffHkiVk Jun 29 08:08:41.293409 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Domain-Id: None Jun 29 08:08:41.293409 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Domain-Name: None Jun 29 08:08:41.293409 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Identity-Status: Confirmed Jun 29 08:08:41.293409 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Is-Admin-Project: True Jun 29 08:08:41.293409 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Project-Domain-Id: default Jun 29 08:08:41.293409 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Project-Domain-Name: Default Jun 29 08:08:41.293409 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Project-Id: ab693125979f4bb7b7b3c94061610fe2 Jun 29 08:08:41.293409 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-796076534 Jun 29 08:08:41.293409 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Role: member,reader Jun 29 08:08:41.293409 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Roles: member,reader Jun 29 08:08:41.295070 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/ab693125979f4bb7b7b3c94061610fe2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_ab693125979f4bb7b7b3c94061610fe2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/ab693125979f4bb7b7b3c94061610fe2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/ab693125979f4bb7b7b3c94061610fe2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Jun 29 08:08:41.295070 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Tenant: tempest-ServerRescueNegativeTestJSON-796076534 Jun 29 08:08:41.295070 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Tenant-Id: ab693125979f4bb7b7b3c94061610fe2 Jun 29 08:08:41.295070 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-796076534 Jun 29 08:08:41.295070 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-User: tempest-ServerRescueNegativeTestJSON-796076534-project Jun 29 08:08:41.295070 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-User-Domain-Id: default Jun 29 08:08:41.295070 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-User-Domain-Name: Default Jun 29 08:08:41.295070 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-User-Id: 1f4af4eedee24897be2e702ef51873b3 Jun 29 08:08:41.295070 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-User-Name: tempest-ServerRescueNegativeTestJSON-796076534-project Jun 29 08:08:41.295070 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: method: > Jun 29 08:08:41.295070 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: exception: Instance 4f1bbb36-8695-4b09-9f25-bfc92ad06a86 could not be found. Jun 29 08:08:41.295070 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: action_args: {'id': '4f1bbb36-8695-4b09-9f25-bfc92ad06a86'} Jun 29 08:08:41.296066 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 08:08:41.296066 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:08:41.296066 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 29 08:08:41.296066 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 29 08:08:41.296066 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 29 08:08:41.296066 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 29 08:08:41.296066 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 29 08:08:41.296066 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 29 08:08:41.296066 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 29 08:08:41.296066 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 29 08:08:41.296066 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4f1bbb36-8695-4b09-9f25-bfc92ad06a86 could not be found. Jun 29 08:08:41.296066 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 29 08:08:41.296066 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 08:08:41.296066 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 29 08:08:41.296066 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:08:41.296066 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 08:08:41.296066 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 08:08:41.296066 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 08:08:41.296066 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 08:08:41.296066 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 08:08:41.299018 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 08:08:41.299018 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 29 08:08:41.299018 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 29 08:08:41.299018 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 29 08:08:41.299018 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 29 08:08:41.299018 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 29 08:08:41.299018 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 29 08:08:41.299018 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4f1bbb36-8695-4b09-9f25-bfc92ad06a86 could not be found. Jun 29 08:08:41.299018 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 29 08:08:41.299018 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 08:08:41.299018 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 29 08:08:41.299018 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:08:41.299018 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 08:08:41.299018 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 08:08:41.299018 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 08:08:41.299018 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 08:08:41.299018 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4f1bbb36-8695-4b09-9f25-bfc92ad06a86 could not be found. Jun 29 08:08:41.299018 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 29 08:08:41.300587 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-5666f48d-8017-42ed-903e-27d34f86ec63 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Returning 404 to user: Instance 4f1bbb36-8695-4b09-9f25-bfc92ad06a86 could not be found. {{(pid=117890) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 08:08:41.300587 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-5666f48d-8017-42ed-903e-27d34f86ec63 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] 10.222.0.43 "GET /compute/v2.1/servers/4f1bbb36-8695-4b09-9f25-bfc92ad06a86" status: 404 len: 111 microversion: 2.1 time: 0.036789 Jun 29 08:08:41.300587 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 319/653] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:08:41 2022] GET /compute/v2.1/servers/4f1bbb36-8695-4b09-9f25-bfc92ad06a86 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 29 08:08:41.304372 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-63d855b3-a7dd-41b2-92b4-c47a20821eef tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:08:41.304872 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-63d855b3-a7dd-41b2-92b4-c47a20821eef tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] [instance: 79765057-c430-4292-bc5f-ee0c6a66b367] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:08:41.311406 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-63d855b3-a7dd-41b2-92b4-c47a20821eef tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:08:41.311866 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-63d855b3-a7dd-41b2-92b4-c47a20821eef tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:08:41.312766 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-63d855b3-a7dd-41b2-92b4-c47a20821eef tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:08:41.313123 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-63d855b3-a7dd-41b2-92b4-c47a20821eef tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:08:41.338255 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-63d855b3-a7dd-41b2-92b4-c47a20821eef tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] [instance: 79765057-c430-4292-bc5f-ee0c6a66b367] Going to try to terminate instance {{(pid=117889) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 29 08:08:41.426323 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-63d855b3-a7dd-41b2-92b4-c47a20821eef tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] 10.222.0.43 "DELETE /compute/v2.1/servers/79765057-c430-4292-bc5f-ee0c6a66b367" status: 204 len: 0 microversion: 2.1 time: 0.125167 Jun 29 08:08:41.426948 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 335/654] 10.222.0.43 () {58 vars in 1238 bytes} [Wed Jun 29 08:08:41 2022] DELETE /compute/v2.1/servers/79765057-c430-4292-bc5f-ee0c6a66b367 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 29 08:08:41.435447 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-4f62bec7-5a19-4eb8-b68d-38ce71b97c6b tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:08:41.436062 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-4f62bec7-5a19-4eb8-b68d-38ce71b97c6b tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] [instance: 79765057-c430-4292-bc5f-ee0c6a66b367] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:08:41.443413 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-4f62bec7-5a19-4eb8-b68d-38ce71b97c6b tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:08:41.443886 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-4f62bec7-5a19-4eb8-b68d-38ce71b97c6b tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:08:41.444650 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-4f62bec7-5a19-4eb8-b68d-38ce71b97c6b tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:08:41.445109 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-4f62bec7-5a19-4eb8-b68d-38ce71b97c6b tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:08:41.588021 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-4f62bec7-5a19-4eb8-b68d-38ce71b97c6b tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4af4eedee24897be2e702ef51873b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab693125979f4bb7b7b3c94061610fe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:08:41.597017 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-4f62bec7-5a19-4eb8-b68d-38ce71b97c6b tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] 10.222.0.43 "GET /compute/v2.1/servers/79765057-c430-4292-bc5f-ee0c6a66b367" status: 200 len: 1522 microversion: 2.1 time: 0.165414 Jun 29 08:08:41.597825 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 320/655] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:08:41 2022] GET /compute/v2.1/servers/79765057-c430-4292-bc5f-ee0c6a66b367 => generated 1522 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:08:42.619038 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-b8435ab3-a61b-4ce3-b124-6d23b963f92c tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:08:42.619750 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-b8435ab3-a61b-4ce3-b124-6d23b963f92c tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] [instance: 79765057-c430-4292-bc5f-ee0c6a66b367] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:08:42.627011 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-b8435ab3-a61b-4ce3-b124-6d23b963f92c tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:08:42.627461 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-b8435ab3-a61b-4ce3-b124-6d23b963f92c tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:08:42.628237 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-b8435ab3-a61b-4ce3-b124-6d23b963f92c tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:08:42.628684 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-b8435ab3-a61b-4ce3-b124-6d23b963f92c tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:08:42.759942 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-b8435ab3-a61b-4ce3-b124-6d23b963f92c tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4af4eedee24897be2e702ef51873b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab693125979f4bb7b7b3c94061610fe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:08:42.767997 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-b8435ab3-a61b-4ce3-b124-6d23b963f92c tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] 10.222.0.43 "GET /compute/v2.1/servers/79765057-c430-4292-bc5f-ee0c6a66b367" status: 200 len: 1522 microversion: 2.1 time: 0.153296 Jun 29 08:08:42.768571 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 336/656] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:08:42 2022] GET /compute/v2.1/servers/79765057-c430-4292-bc5f-ee0c6a66b367 => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:08:43.784748 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-c06cc693-f6e2-4d2a-836a-8e4626066ccd tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:08:43.785348 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-c06cc693-f6e2-4d2a-836a-8e4626066ccd tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] [instance: 79765057-c430-4292-bc5f-ee0c6a66b367] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:08:43.791890 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-c06cc693-f6e2-4d2a-836a-8e4626066ccd tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:08:43.792357 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-c06cc693-f6e2-4d2a-836a-8e4626066ccd tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:08:43.793153 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-c06cc693-f6e2-4d2a-836a-8e4626066ccd tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:08:43.793597 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-c06cc693-f6e2-4d2a-836a-8e4626066ccd tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:08:43.931781 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-c06cc693-f6e2-4d2a-836a-8e4626066ccd tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4af4eedee24897be2e702ef51873b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab693125979f4bb7b7b3c94061610fe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:08:43.939844 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-c06cc693-f6e2-4d2a-836a-8e4626066ccd tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] 10.222.0.43 "GET /compute/v2.1/servers/79765057-c430-4292-bc5f-ee0c6a66b367" status: 200 len: 1522 microversion: 2.1 time: 0.159556 Jun 29 08:08:43.940963 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 321/657] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:08:43 2022] GET /compute/v2.1/servers/79765057-c430-4292-bc5f-ee0c6a66b367 => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:08:44.598474 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [req-5093cd3a-241f-48ff-aea2-caf6be5d6b3f req-ad18b8d6-7995-4cb9-9e54-a78eec538d80 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79765057-c430-4292-bc5f-ee0c6a66b367", "name": "network-vif-deleted", "tag": "fcb56668-c13f-4fb2-83eb-845e29b080ce"}]} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:08:44.607813 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-5093cd3a-241f-48ff-aea2-caf6be5d6b3f req-ad18b8d6-7995-4cb9-9e54-a78eec538d80 service nova] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:08:44.608256 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-5093cd3a-241f-48ff-aea2-caf6be5d6b3f req-ad18b8d6-7995-4cb9-9e54-a78eec538d80 service nova] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:08:44.622561 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.compute.server_external_events [req-5093cd3a-241f-48ff-aea2-caf6be5d6b3f req-ad18b8d6-7995-4cb9-9e54-a78eec538d80 service nova] Creating event network-vif-deleted:fcb56668-c13f-4fb2-83eb-845e29b080ce for instance 79765057-c430-4292-bc5f-ee0c6a66b367 on hv-cinder-76810 Jun 29 08:08:44.630304 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [req-5093cd3a-241f-48ff-aea2-caf6be5d6b3f req-ad18b8d6-7995-4cb9-9e54-a78eec538d80 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035013 Jun 29 08:08:44.631833 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 337/658] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jun 29 08:08:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:08:44.958835 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-7f78588d-d871-4aac-8e11-043b2cf39d67 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:08:44.959558 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-7f78588d-d871-4aac-8e11-043b2cf39d67 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] [instance: 79765057-c430-4292-bc5f-ee0c6a66b367] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:08:44.966373 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-7f78588d-d871-4aac-8e11-043b2cf39d67 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:08:44.966847 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-7f78588d-d871-4aac-8e11-043b2cf39d67 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:08:44.967629 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-7f78588d-d871-4aac-8e11-043b2cf39d67 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:08:44.968065 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-7f78588d-d871-4aac-8e11-043b2cf39d67 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:08:45.002383 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-7f78588d-d871-4aac-8e11-043b2cf39d67 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:08:45.002863 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-7f78588d-d871-4aac-8e11-043b2cf39d67 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:08:45.003280 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.objects.instance [None req-7f78588d-d871-4aac-8e11-043b2cf39d67 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lazy-loading 'fault' on Instance uuid 79765057-c430-4292-bc5f-ee0c6a66b367 {{(pid=117890) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 29 08:08:45.048176 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-7f78588d-d871-4aac-8e11-043b2cf39d67 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f4af4eedee24897be2e702ef51873b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab693125979f4bb7b7b3c94061610fe2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:08:45.056751 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-7f78588d-d871-4aac-8e11-043b2cf39d67 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] 10.222.0.43 "GET /compute/v2.1/servers/79765057-c430-4292-bc5f-ee0c6a66b367" status: 200 len: 1312 microversion: 2.1 time: 0.101769 Jun 29 08:08:45.057380 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 322/659] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:08:44 2022] GET /compute/v2.1/servers/79765057-c430-4292-bc5f-ee0c6a66b367 => generated 1312 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:08:46.084256 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-5204b439-be73-4989-b597-60c85c77f262 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:08:46.084950 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-5204b439-be73-4989-b597-60c85c77f262 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] [instance: 79765057-c430-4292-bc5f-ee0c6a66b367] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:08:46.091326 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-5204b439-be73-4989-b597-60c85c77f262 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:08:46.091774 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-5204b439-be73-4989-b597-60c85c77f262 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:08:46.092542 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-5204b439-be73-4989-b597-60c85c77f262 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:08:46.092991 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-5204b439-be73-4989-b597-60c85c77f262 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:08:46.107753 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.wsgi [None req-5204b439-be73-4989-b597-60c85c77f262 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] HTTP exception thrown: Instance 79765057-c430-4292-bc5f-ee0c6a66b367 could not be found. Jun 29 08:08:46.109869 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-5204b439-be73-4989-b597-60c85c77f262 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Request method failure captured: Jun 29 08:08:46.109869 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: request: GET /compute/v2.1/servers/79765057-c430-4292-bc5f-ee0c6a66b367 HTTP/1.1 Jun 29 08:08:46.109869 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: Accept: application/json Jun 29 08:08:46.109869 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: Accept-Encoding: identity Jun 29 08:08:46.109869 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: Connection: close Jun 29 08:08:46.109869 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: Content-Length: 0 Jun 29 08:08:46.109869 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: Content-Type: application/json Jun 29 08:08:46.109869 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: Host: 10.222.0.43 Jun 29 08:08:46.109869 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: Openstack-System-Scope: None Jun 29 08:08:46.109869 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: User-Agent: python-urllib3/1.26.9 Jun 29 08:08:46.109869 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Auth-Token: gAAAAABivAcrRGv8n-hBTzbO-mvdA9ZuWTSzlFAkKkndDN8FN_iXGvsZd7rjQm_nN6TZnE7JfsJp8_xcKjzwxgIiNSK_dDCsCpCeOaZ_u5KXcRULb_0_OxKetSiSEtrbxD9wcdC3B0H-F_SoNZ4yDrjB8_rwxeM6bFtzhz_78UcZZraaffHkiVk Jun 29 08:08:46.109869 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Domain-Id: None Jun 29 08:08:46.109869 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Domain-Name: None Jun 29 08:08:46.109869 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Identity-Status: Confirmed Jun 29 08:08:46.109869 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Is-Admin-Project: True Jun 29 08:08:46.109869 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Project-Domain-Id: default Jun 29 08:08:46.109869 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Project-Domain-Name: Default Jun 29 08:08:46.109869 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Project-Id: ab693125979f4bb7b7b3c94061610fe2 Jun 29 08:08:46.109869 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-796076534 Jun 29 08:08:46.109869 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Role: member,reader Jun 29 08:08:46.109869 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Roles: member,reader Jun 29 08:08:46.112805 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/ab693125979f4bb7b7b3c94061610fe2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_ab693125979f4bb7b7b3c94061610fe2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/ab693125979f4bb7b7b3c94061610fe2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/ab693125979f4bb7b7b3c94061610fe2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Jun 29 08:08:46.112805 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Tenant: tempest-ServerRescueNegativeTestJSON-796076534 Jun 29 08:08:46.112805 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Tenant-Id: ab693125979f4bb7b7b3c94061610fe2 Jun 29 08:08:46.112805 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-796076534 Jun 29 08:08:46.112805 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-User: tempest-ServerRescueNegativeTestJSON-796076534-project Jun 29 08:08:46.112805 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-User-Domain-Id: default Jun 29 08:08:46.112805 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-User-Domain-Name: Default Jun 29 08:08:46.112805 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-User-Id: 1f4af4eedee24897be2e702ef51873b3 Jun 29 08:08:46.112805 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-User-Name: tempest-ServerRescueNegativeTestJSON-796076534-project Jun 29 08:08:46.112805 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: method: > Jun 29 08:08:46.112805 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: exception: Instance 79765057-c430-4292-bc5f-ee0c6a66b367 could not be found. Jun 29 08:08:46.112805 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: action_args: {'id': '79765057-c430-4292-bc5f-ee0c6a66b367'} Jun 29 08:08:46.116031 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 08:08:46.116031 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:08:46.116031 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 29 08:08:46.116031 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 29 08:08:46.116031 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 29 08:08:46.116031 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 29 08:08:46.116031 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 29 08:08:46.116031 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 29 08:08:46.116031 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 29 08:08:46.116031 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 29 08:08:46.116031 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 79765057-c430-4292-bc5f-ee0c6a66b367 could not be found. Jun 29 08:08:46.116031 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 29 08:08:46.116031 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 08:08:46.116031 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 29 08:08:46.116031 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:08:46.116031 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 08:08:46.116031 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 08:08:46.116031 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 08:08:46.116031 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 08:08:46.116031 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 08:08:46.122908 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 08:08:46.122908 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 29 08:08:46.122908 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 29 08:08:46.122908 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 29 08:08:46.122908 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 29 08:08:46.122908 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 29 08:08:46.122908 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 29 08:08:46.122908 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 79765057-c430-4292-bc5f-ee0c6a66b367 could not be found. Jun 29 08:08:46.122908 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 29 08:08:46.122908 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 08:08:46.122908 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 29 08:08:46.122908 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:08:46.122908 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 08:08:46.122908 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 08:08:46.122908 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 08:08:46.122908 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 08:08:46.122908 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 79765057-c430-4292-bc5f-ee0c6a66b367 could not be found. Jun 29 08:08:46.122908 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 29 08:08:46.124237 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-5204b439-be73-4989-b597-60c85c77f262 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] Returning 404 to user: Instance 79765057-c430-4292-bc5f-ee0c6a66b367 could not be found. {{(pid=117889) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 08:08:46.124237 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-5204b439-be73-4989-b597-60c85c77f262 tempest-ServerRescueNegativeTestJSON-796076534 tempest-ServerRescueNegativeTestJSON-796076534-project] 10.222.0.43 "GET /compute/v2.1/servers/79765057-c430-4292-bc5f-ee0c6a66b367" status: 404 len: 111 microversion: 2.1 time: 0.031729 Jun 29 08:08:46.124237 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 338/660] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:08:46 2022] GET /compute/v2.1/servers/79765057-c430-4292-bc5f-ee0c6a66b367 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 29 08:08:53.782432 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-a0e27661-5dbe-436a-992d-df05b3169a7b tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:08:53.784156 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-a0e27661-5dbe-436a-992d-df05b3169a7b tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] [instance: d7e8f0a8-6cfe-4b0e-818a-a078672dbd87] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:08:53.787602 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG dbcounter [-] [117890] Writing DB stats nova_api:SELECT=57,nova_api:UPDATE=3 {{(pid=117890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:08:53.796619 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-a0e27661-5dbe-436a-992d-df05b3169a7b tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:08:53.797624 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-a0e27661-5dbe-436a-992d-df05b3169a7b tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:08:53.798739 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-a0e27661-5dbe-436a-992d-df05b3169a7b tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:08:53.799283 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-a0e27661-5dbe-436a-992d-df05b3169a7b tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:08:53.834621 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-a0e27661-5dbe-436a-992d-df05b3169a7b tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] 10.222.0.43 "GET /compute/v2.1/servers/d7e8f0a8-6cfe-4b0e-818a-a078672dbd87/ips" status: 200 len: 145 microversion: 2.1 time: 0.058191 Jun 29 08:08:53.835275 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 323/661] 10.222.0.43 () {58 vars in 1247 bytes} [Wed Jun 29 08:08:53 2022] GET /compute/v2.1/servers/d7e8f0a8-6cfe-4b0e-818a-a078672dbd87/ips => generated 145 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:08:55.347986 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-1faa21e9-6b2f-4a33-b77c-5f9b4cd17943 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "48f16aa2-33f8-4a69-8943-03964d0855a2"}} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:08:55.349828 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-1faa21e9-6b2f-4a33-b77c-5f9b4cd17943 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] [instance: d7e8f0a8-6cfe-4b0e-818a-a078672dbd87] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:08:55.357423 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_api:SELECT=49,nova_api:DELETE=2,nova_api:UPDATE=1 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:08:55.359833 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-1faa21e9-6b2f-4a33-b77c-5f9b4cd17943 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:08:55.361158 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-1faa21e9-6b2f-4a33-b77c-5f9b4cd17943 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:08:55.361973 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-1faa21e9-6b2f-4a33-b77c-5f9b4cd17943 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:08:55.362405 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-1faa21e9-6b2f-4a33-b77c-5f9b4cd17943 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:08:55.686109 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-1faa21e9-6b2f-4a33-b77c-5f9b4cd17943 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] 10.222.0.43 "POST /compute/v2.1/servers/d7e8f0a8-6cfe-4b0e-818a-a078672dbd87/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.342737 Jun 29 08:08:55.686999 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 339/662] 10.222.0.43 () {60 vars in 1322 bytes} [Wed Jun 29 08:08:55 2022] POST /compute/v2.1/servers/d7e8f0a8-6cfe-4b0e-818a-a078672dbd87/os-volume_attachments => generated 194 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:08:55.789592 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-a7b0fa63-339e-4cee-a69c-1eb41c027e13 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:08:55.791266 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-a7b0fa63-339e-4cee-a69c-1eb41c027e13 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] [instance: 4e4c90a0-14de-401e-80d5-fe4bf684d991] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:08:55.800156 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-a7b0fa63-339e-4cee-a69c-1eb41c027e13 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:08:55.800861 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-a7b0fa63-339e-4cee-a69c-1eb41c027e13 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:08:55.801870 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-a7b0fa63-339e-4cee-a69c-1eb41c027e13 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:08:55.802621 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-a7b0fa63-339e-4cee-a69c-1eb41c027e13 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:08:55.834163 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-a7b0fa63-339e-4cee-a69c-1eb41c027e13 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] 10.222.0.43 "GET /compute/v2.1/servers/4e4c90a0-14de-401e-80d5-fe4bf684d991/ips" status: 200 len: 152 microversion: 2.20 time: 0.054112 Jun 29 08:08:55.834793 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 324/663] 10.222.0.43 () {60 vars in 1288 bytes} [Wed Jun 29 08:08:55 2022] GET /compute/v2.1/servers/4e4c90a0-14de-401e-80d5-fe4bf684d991/ips => generated 152 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 29 08:08:56.778914 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-71c8bdfa-f975-438f-88fd-7b4e20564396 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Action: 'create', calling method: .version_select at 0x7f7241161310>, body: {"keypair": {"name": "tempest-keypair-586181879", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGzdajzAwrK5VF2O9IPLKuGpW2F5FibQOL/rCNVXZ3+LOabgDIymeS2sKDMor0GepLFxCClbZ31ITOGGQ7aF9ss8CrU2607f/4g3kyY7gYdAFMGldAk8J8xXVrF4FSeQPg=="}} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:08:56.795752 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.quota [None req-71c8bdfa-f975-438f-88fd-7b4e20564396 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Getting quotas for project a4df15f6a6dd45dab12d0b724076a23e. Resources: {'key_pairs'} {{(pid=117889) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 29 08:08:56.800553 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.quota [None req-71c8bdfa-f975-438f-88fd-7b4e20564396 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Getting quotas for user 4873db0f2fbf4a77a617f2102a5ccfae and project a4df15f6a6dd45dab12d0b724076a23e. Resources: {'key_pairs'} {{(pid=117889) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 29 08:08:56.830861 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-71c8bdfa-f975-438f-88fd-7b4e20564396 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.253246 Jun 29 08:08:56.831822 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 340/664] 10.222.0.43 () {60 vars in 1158 bytes} [Wed Jun 29 08:08:56 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:08:57.983817 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-354ab97d-e47a-407e-9420-63cc406f5e6b tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:08:57.986297 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-354ab97d-e47a-407e-9420-63cc406f5e6b tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] [instance: 4e4c90a0-14de-401e-80d5-fe4bf684d991] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:08:57.993019 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-354ab97d-e47a-407e-9420-63cc406f5e6b tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:08:57.993791 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-354ab97d-e47a-407e-9420-63cc406f5e6b tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:08:57.994573 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-354ab97d-e47a-407e-9420-63cc406f5e6b tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:08:57.995186 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-354ab97d-e47a-407e-9420-63cc406f5e6b tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:08:58.023432 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.objects.instance [None req-354ab97d-e47a-407e-9420-63cc406f5e6b tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lazy-loading 'flavor' on Instance uuid 4e4c90a0-14de-401e-80d5-fe4bf684d991 {{(pid=117890) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 29 08:08:58.344915 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-5f0bc020-a332-4de4-b2c9-3cc0d3b21a3a tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1527995767", "imageRef": "5d2148a0-3628-4eff-88e9-5686abc0d33e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "501bffb4-f18b-4ba3-b604-4fd9c7554413"}], "security_groups": [{"name": "tempest-securitygroup--1838511873"}], "key_name": "tempest-keypair-586181879", "user_data": "}} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:08:58.349675 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-354ab97d-e47a-407e-9420-63cc406f5e6b tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] 10.222.0.43 "POST /compute/v2.1/servers/4e4c90a0-14de-401e-80d5-fe4bf684d991/action" status: 202 len: 0 microversion: 2.20 time: 0.372657 Jun 29 08:08:58.350326 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 325/665] 10.222.0.43 () {62 vars in 1318 bytes} [Wed Jun 29 08:08:57 2022] POST /compute/v2.1/servers/4e4c90a0-14de-401e-80d5-fe4bf684d991/action => generated 0 bytes in 374 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 29 08:08:58.363158 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-ef84e2fb-f94e-4401-8752-f417d4b5f637 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:08:58.364149 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-ef84e2fb-f94e-4401-8752-f417d4b5f637 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] [instance: 4e4c90a0-14de-401e-80d5-fe4bf684d991] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:08:58.371920 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-ef84e2fb-f94e-4401-8752-f417d4b5f637 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:08:58.372328 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-ef84e2fb-f94e-4401-8752-f417d4b5f637 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:08:58.374303 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-ef84e2fb-f94e-4401-8752-f417d4b5f637 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:08:58.374997 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-ef84e2fb-f94e-4401-8752-f417d4b5f637 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:08:58.511056 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.network.neutron [None req-5f0bc020-a332-4de4-b2c9-3cc0d3b21a3a tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] validate_networks() for [('501bffb4-f18b-4ba3-b604-4fd9c7554413', None, None, None, None, None)] {{(pid=117889) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 29 08:08:58.596216 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-ef84e2fb-f94e-4401-8752-f417d4b5f637 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:08:58.605898 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-ef84e2fb-f94e-4401-8752-f417d4b5f637 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:08:58.608536 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-ef84e2fb-f94e-4401-8752-f417d4b5f637 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:08:58.611456 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-ef84e2fb-f94e-4401-8752-f417d4b5f637 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] 10.222.0.43 "GET /compute/v2.1/servers/4e4c90a0-14de-401e-80d5-fe4bf684d991" status: 200 len: 1723 microversion: 2.20 time: 0.255877 Jun 29 08:08:58.623775 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 326/666] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 29 08:08:58 2022] GET /compute/v2.1/servers/4e4c90a0-14de-401e-80d5-fe4bf684d991 => generated 1723 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 29 08:08:59.064568 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.virt.hardware [None req-5f0bc020-a332-4de4-b2c9-3cc0d3b21a3a tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Flavor limits 0:0:0 {{(pid=117889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 29 08:08:59.065479 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.virt.hardware [None req-5f0bc020-a332-4de4-b2c9-3cc0d3b21a3a tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Image limits 0:0:0 {{(pid=117889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 29 08:08:59.065781 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.virt.hardware [None req-5f0bc020-a332-4de4-b2c9-3cc0d3b21a3a tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Flavor pref 0:0:0 {{(pid=117889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 29 08:08:59.066208 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.virt.hardware [None req-5f0bc020-a332-4de4-b2c9-3cc0d3b21a3a tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Image pref 0:0:0 {{(pid=117889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 29 08:08:59.066629 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.virt.hardware [None req-5f0bc020-a332-4de4-b2c9-3cc0d3b21a3a tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 29 08:08:59.077096 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-5f0bc020-a332-4de4-b2c9-3cc0d3b21a3a tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:08:59.077808 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-5f0bc020-a332-4de4-b2c9-3cc0d3b21a3a tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:08:59.079351 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-5f0bc020-a332-4de4-b2c9-3cc0d3b21a3a tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:08:59.079971 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-5f0bc020-a332-4de4-b2c9-3cc0d3b21a3a tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:08:59.100915 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.quota [None req-5f0bc020-a332-4de4-b2c9-3cc0d3b21a3a tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Getting quotas for project a4df15f6a6dd45dab12d0b724076a23e. Resources: {'ram', 'instances', 'cores'} {{(pid=117889) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 29 08:08:59.105950 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.quota [None req-5f0bc020-a332-4de4-b2c9-3cc0d3b21a3a tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Getting quotas for user 4873db0f2fbf4a77a617f2102a5ccfae and project a4df15f6a6dd45dab12d0b724076a23e. Resources: {'ram', 'instances', 'cores'} {{(pid=117889) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 29 08:08:59.120074 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-5f0bc020-a332-4de4-b2c9-3cc0d3b21a3a tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Going to run 1 instances... {{(pid=117889) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 29 08:08:59.122975 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-5f0bc020-a332-4de4-b2c9-3cc0d3b21a3a tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] [instance: 57b6d980-40de-4505-a591-20b54645d37c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5d2148a0-3628-4eff-88e9-5686abc0d33e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117889) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 29 08:08:59.189985 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-5f0bc020-a332-4de4-b2c9-3cc0d3b21a3a tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.851332 Jun 29 08:08:59.191067 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 341/667] 10.222.0.43 () {60 vars in 1146 bytes} [Wed Jun 29 08:08:58 2022] POST /compute/v2.1/servers => generated 402 bytes in 853 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 29 08:08:59.201762 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-e1c39b4e-8ff9-464a-bcff-22fcdf7112db tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:08:59.203172 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-e1c39b4e-8ff9-464a-bcff-22fcdf7112db tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] [instance: 57b6d980-40de-4505-a591-20b54645d37c] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:08:59.300689 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-e1c39b4e-8ff9-464a-bcff-22fcdf7112db tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4873db0f2fbf4a77a617f2102a5ccfae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4df15f6a6dd45dab12d0b724076a23e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:08:59.307607 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-e1c39b4e-8ff9-464a-bcff-22fcdf7112db tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] 10.222.0.43 "GET /compute/v2.1/servers/57b6d980-40de-4505-a591-20b54645d37c" status: 200 len: 1241 microversion: 2.1 time: 0.110436 Jun 29 08:08:59.308778 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 327/668] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:08:59 2022] GET /compute/v2.1/servers/57b6d980-40de-4505-a591-20b54645d37c => generated 1241 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 08:08:59.632072 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-5b409e46-181e-4de2-be73-9e1ef36c39b4 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:08:59.633514 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-5b409e46-181e-4de2-be73-9e1ef36c39b4 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] [instance: 4e4c90a0-14de-401e-80d5-fe4bf684d991] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:08:59.642255 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-5b409e46-181e-4de2-be73-9e1ef36c39b4 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:08:59.642717 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-5b409e46-181e-4de2-be73-9e1ef36c39b4 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:08:59.643530 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-5b409e46-181e-4de2-be73-9e1ef36c39b4 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:08:59.643973 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-5b409e46-181e-4de2-be73-9e1ef36c39b4 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:08:59.805371 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-5b409e46-181e-4de2-be73-9e1ef36c39b4 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:08:59.815360 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-5b409e46-181e-4de2-be73-9e1ef36c39b4 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:08:59.817265 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-5b409e46-181e-4de2-be73-9e1ef36c39b4 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:08:59.818698 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-5b409e46-181e-4de2-be73-9e1ef36c39b4 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] 10.222.0.43 "GET /compute/v2.1/servers/4e4c90a0-14de-401e-80d5-fe4bf684d991" status: 200 len: 1723 microversion: 2.20 time: 0.192047 Jun 29 08:08:59.819438 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 342/669] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 29 08:08:59 2022] GET /compute/v2.1/servers/4e4c90a0-14de-401e-80d5-fe4bf684d991 => generated 1723 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:09:00.325606 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-1a0a73a6-db64-4bc5-a8b6-f3bbb9f27547 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:09:00.326234 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-1a0a73a6-db64-4bc5-a8b6-f3bbb9f27547 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] [instance: 57b6d980-40de-4505-a591-20b54645d37c] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:09:00.334888 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-1a0a73a6-db64-4bc5-a8b6-f3bbb9f27547 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:09:00.335642 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-1a0a73a6-db64-4bc5-a8b6-f3bbb9f27547 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:09:00.336610 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-1a0a73a6-db64-4bc5-a8b6-f3bbb9f27547 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:09:00.337094 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-1a0a73a6-db64-4bc5-a8b6-f3bbb9f27547 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:09:00.423312 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-1a0a73a6-db64-4bc5-a8b6-f3bbb9f27547 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4873db0f2fbf4a77a617f2102a5ccfae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4df15f6a6dd45dab12d0b724076a23e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:09:00.433641 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-1a0a73a6-db64-4bc5-a8b6-f3bbb9f27547 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] 10.222.0.43 "GET /compute/v2.1/servers/57b6d980-40de-4505-a591-20b54645d37c" status: 200 len: 1293 microversion: 2.1 time: 0.111648 Jun 29 08:09:00.441026 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 328/670] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:09:00 2022] GET /compute/v2.1/servers/57b6d980-40de-4505-a591-20b54645d37c => generated 1293 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:09:00.838082 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-e13081b4-8db2-4a5c-b9e8-8316ffde6551 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:09:00.838690 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-e13081b4-8db2-4a5c-b9e8-8316ffde6551 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] [instance: 4e4c90a0-14de-401e-80d5-fe4bf684d991] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:09:00.845777 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e13081b4-8db2-4a5c-b9e8-8316ffde6551 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:09:00.846230 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e13081b4-8db2-4a5c-b9e8-8316ffde6551 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:09:00.847164 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e13081b4-8db2-4a5c-b9e8-8316ffde6551 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:09:00.847603 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e13081b4-8db2-4a5c-b9e8-8316ffde6551 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:09:00.991661 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-e13081b4-8db2-4a5c-b9e8-8316ffde6551 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:09:01.001522 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-e13081b4-8db2-4a5c-b9e8-8316ffde6551 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:09:01.003189 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-e13081b4-8db2-4a5c-b9e8-8316ffde6551 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:09:01.007077 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-e13081b4-8db2-4a5c-b9e8-8316ffde6551 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] 10.222.0.43 "GET /compute/v2.1/servers/4e4c90a0-14de-401e-80d5-fe4bf684d991" status: 200 len: 1723 microversion: 2.20 time: 0.172470 Jun 29 08:09:01.008001 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 343/671] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 29 08:09:00 2022] GET /compute/v2.1/servers/4e4c90a0-14de-401e-80d5-fe4bf684d991 => generated 1723 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:09:01.451831 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-2fd9df21-dbd8-4fc6-8cc6-0995ad0e429b tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:09:01.452442 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-2fd9df21-dbd8-4fc6-8cc6-0995ad0e429b tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] [instance: 57b6d980-40de-4505-a591-20b54645d37c] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:09:01.459124 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-2fd9df21-dbd8-4fc6-8cc6-0995ad0e429b tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:09:01.459574 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-2fd9df21-dbd8-4fc6-8cc6-0995ad0e429b tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:09:01.460336 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-2fd9df21-dbd8-4fc6-8cc6-0995ad0e429b tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:09:01.460768 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-2fd9df21-dbd8-4fc6-8cc6-0995ad0e429b tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:09:01.707150 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-2fd9df21-dbd8-4fc6-8cc6-0995ad0e429b tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4873db0f2fbf4a77a617f2102a5ccfae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4df15f6a6dd45dab12d0b724076a23e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:09:01.716678 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-2fd9df21-dbd8-4fc6-8cc6-0995ad0e429b tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] 10.222.0.43 "GET /compute/v2.1/servers/57b6d980-40de-4505-a591-20b54645d37c" status: 200 len: 1367 microversion: 2.1 time: 0.268730 Jun 29 08:09:01.717289 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 329/672] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:09:01 2022] GET /compute/v2.1/servers/57b6d980-40de-4505-a591-20b54645d37c => generated 1367 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:09:02.027760 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-61ca3255-8c03-4538-ac66-769a5135fd29 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:09:02.028548 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-61ca3255-8c03-4538-ac66-769a5135fd29 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] [instance: 4e4c90a0-14de-401e-80d5-fe4bf684d991] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:09:02.035858 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-61ca3255-8c03-4538-ac66-769a5135fd29 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:09:02.036414 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-61ca3255-8c03-4538-ac66-769a5135fd29 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:09:02.037329 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-61ca3255-8c03-4538-ac66-769a5135fd29 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:09:02.038020 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-61ca3255-8c03-4538-ac66-769a5135fd29 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:09:02.124217 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [req-249f1a6a-4ba0-450f-9fd2-75a37bc1ad9f req-6089115d-605f-45df-9fbb-14b387181821 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "57b6d980-40de-4505-a591-20b54645d37c", "tag": "ef9d6628-7dec-44df-ae2b-420055caab1c"}]} {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:09:02.157245 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [req-249f1a6a-4ba0-450f-9fd2-75a37bc1ad9f req-6089115d-605f-45df-9fbb-14b387181821 service nova] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:09:02.158357 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [req-249f1a6a-4ba0-450f-9fd2-75a37bc1ad9f req-6089115d-605f-45df-9fbb-14b387181821 service nova] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:09:02.186889 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.compute.server_external_events [req-249f1a6a-4ba0-450f-9fd2-75a37bc1ad9f req-6089115d-605f-45df-9fbb-14b387181821 service nova] Creating event network-changed:ef9d6628-7dec-44df-ae2b-420055caab1c for instance 57b6d980-40de-4505-a591-20b54645d37c on hv-cinder-76810 Jun 29 08:09:02.193362 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [req-249f1a6a-4ba0-450f-9fd2-75a37bc1ad9f req-6089115d-605f-45df-9fbb-14b387181821 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076208 Jun 29 08:09:02.194069 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 330/673] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jun 29 08:09:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:09:02.248886 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-61ca3255-8c03-4538-ac66-769a5135fd29 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:09:02.259294 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-61ca3255-8c03-4538-ac66-769a5135fd29 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:09:02.261589 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-61ca3255-8c03-4538-ac66-769a5135fd29 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:09:02.262836 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-61ca3255-8c03-4538-ac66-769a5135fd29 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] 10.222.0.43 "GET /compute/v2.1/servers/4e4c90a0-14de-401e-80d5-fe4bf684d991" status: 200 len: 1723 microversion: 2.20 time: 0.239100 Jun 29 08:09:02.273352 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 344/674] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 29 08:09:02 2022] GET /compute/v2.1/servers/4e4c90a0-14de-401e-80d5-fe4bf684d991 => generated 1723 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:09:02.737315 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-4f1e26fa-4696-4208-88a7-57302824db2c tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:09:02.738599 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-4f1e26fa-4696-4208-88a7-57302824db2c tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] [instance: 57b6d980-40de-4505-a591-20b54645d37c] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:09:02.750483 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-4f1e26fa-4696-4208-88a7-57302824db2c tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:09:02.751323 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-4f1e26fa-4696-4208-88a7-57302824db2c tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:09:02.752703 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-4f1e26fa-4696-4208-88a7-57302824db2c tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:09:02.753754 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-4f1e26fa-4696-4208-88a7-57302824db2c tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:09:02.986067 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-4f1e26fa-4696-4208-88a7-57302824db2c tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4873db0f2fbf4a77a617f2102a5ccfae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4df15f6a6dd45dab12d0b724076a23e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:09:02.996794 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-4f1e26fa-4696-4208-88a7-57302824db2c tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] 10.222.0.43 "GET /compute/v2.1/servers/57b6d980-40de-4505-a591-20b54645d37c" status: 200 len: 1367 microversion: 2.1 time: 0.266258 Jun 29 08:09:02.997439 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 331/675] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:09:02 2022] GET /compute/v2.1/servers/57b6d980-40de-4505-a591-20b54645d37c => generated 1367 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 08:09:03.283146 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-fc2ced04-a070-4828-b783-625724dfc2c7 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:09:03.284375 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-fc2ced04-a070-4828-b783-625724dfc2c7 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] [instance: 4e4c90a0-14de-401e-80d5-fe4bf684d991] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:09:03.291714 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-fc2ced04-a070-4828-b783-625724dfc2c7 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:09:03.292162 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-fc2ced04-a070-4828-b783-625724dfc2c7 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:09:03.293000 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-fc2ced04-a070-4828-b783-625724dfc2c7 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:09:03.293455 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-fc2ced04-a070-4828-b783-625724dfc2c7 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:09:03.317859 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-f989d9ba-e75a-4563-87aa-9f5b1c9c338e tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:09:03.318963 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-f989d9ba-e75a-4563-87aa-9f5b1c9c338e tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] [instance: d7e8f0a8-6cfe-4b0e-818a-a078672dbd87] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:09:03.326276 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-f989d9ba-e75a-4563-87aa-9f5b1c9c338e tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:09:03.326790 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-f989d9ba-e75a-4563-87aa-9f5b1c9c338e tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:09:03.328316 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-f989d9ba-e75a-4563-87aa-9f5b1c9c338e tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:09:03.328914 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-f989d9ba-e75a-4563-87aa-9f5b1c9c338e tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:09:03.366180 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-f989d9ba-e75a-4563-87aa-9f5b1c9c338e tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] 10.222.0.43 "GET /compute/v2.1/servers/d7e8f0a8-6cfe-4b0e-818a-a078672dbd87/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053302 Jun 29 08:09:03.366988 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 332/676] 10.222.0.43 () {58 vars in 1301 bytes} [Wed Jun 29 08:09:03 2022] GET /compute/v2.1/servers/d7e8f0a8-6cfe-4b0e-818a-a078672dbd87/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 29 08:09:03.378586 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-18a6e786-687c-49b8-9a77-2005053f7dd2 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:09:03.379070 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-18a6e786-687c-49b8-9a77-2005053f7dd2 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] [instance: d7e8f0a8-6cfe-4b0e-818a-a078672dbd87] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:09:03.385524 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-18a6e786-687c-49b8-9a77-2005053f7dd2 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:09:03.385974 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-18a6e786-687c-49b8-9a77-2005053f7dd2 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:09:03.386749 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-18a6e786-687c-49b8-9a77-2005053f7dd2 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:09:03.387181 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-18a6e786-687c-49b8-9a77-2005053f7dd2 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:09:03.420742 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-18a6e786-687c-49b8-9a77-2005053f7dd2 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] 10.222.0.43 "GET /compute/v2.1/servers/d7e8f0a8-6cfe-4b0e-818a-a078672dbd87/os-volume_attachments/48f16aa2-33f8-4a69-8943-03964d0855a2" status: 200 len: 194 microversion: 2.1 time: 0.046747 Jun 29 08:09:03.422516 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 333/677] 10.222.0.43 () {58 vars in 1412 bytes} [Wed Jun 29 08:09:03 2022] GET /compute/v2.1/servers/d7e8f0a8-6cfe-4b0e-818a-a078672dbd87/os-volume_attachments/48f16aa2-33f8-4a69-8943-03964d0855a2 => generated 194 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 29 08:09:03.445442 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-fc2ced04-a070-4828-b783-625724dfc2c7 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:09:03.457376 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-fc2ced04-a070-4828-b783-625724dfc2c7 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:09:03.461707 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-fc2ced04-a070-4828-b783-625724dfc2c7 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:09:03.463271 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-fc2ced04-a070-4828-b783-625724dfc2c7 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] 10.222.0.43 "GET /compute/v2.1/servers/4e4c90a0-14de-401e-80d5-fe4bf684d991" status: 200 len: 1723 microversion: 2.20 time: 0.184798 Jun 29 08:09:03.464384 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 345/678] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 29 08:09:03 2022] GET /compute/v2.1/servers/4e4c90a0-14de-401e-80d5-fe4bf684d991 => generated 1723 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 29 08:09:04.016841 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-0e324a1b-9f84-4914-b19a-63e6e81170e0 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:09:04.017647 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-0e324a1b-9f84-4914-b19a-63e6e81170e0 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] [instance: 57b6d980-40de-4505-a591-20b54645d37c] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:09:04.025436 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-0e324a1b-9f84-4914-b19a-63e6e81170e0 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:09:04.025878 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-0e324a1b-9f84-4914-b19a-63e6e81170e0 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:09:04.026914 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-0e324a1b-9f84-4914-b19a-63e6e81170e0 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:09:04.027349 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-0e324a1b-9f84-4914-b19a-63e6e81170e0 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:09:04.030626 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG dbcounter [-] [117890] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=117890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:09:04.278374 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-0e324a1b-9f84-4914-b19a-63e6e81170e0 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4873db0f2fbf4a77a617f2102a5ccfae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4df15f6a6dd45dab12d0b724076a23e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:09:04.286340 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-0e324a1b-9f84-4914-b19a-63e6e81170e0 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] 10.222.0.43 "GET /compute/v2.1/servers/57b6d980-40de-4505-a591-20b54645d37c" status: 200 len: 1367 microversion: 2.1 time: 0.274395 Jun 29 08:09:04.286931 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 334/679] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:09:04 2022] GET /compute/v2.1/servers/57b6d980-40de-4505-a591-20b54645d37c => generated 1367 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:09:04.482274 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-22e3ebd9-945f-47e5-8236-33c76b04e6fb tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:09:04.483006 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-22e3ebd9-945f-47e5-8236-33c76b04e6fb tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] [instance: 4e4c90a0-14de-401e-80d5-fe4bf684d991] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:09:04.491345 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-22e3ebd9-945f-47e5-8236-33c76b04e6fb tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:09:04.491805 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-22e3ebd9-945f-47e5-8236-33c76b04e6fb tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:09:04.492589 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-22e3ebd9-945f-47e5-8236-33c76b04e6fb tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:09:04.493058 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-22e3ebd9-945f-47e5-8236-33c76b04e6fb tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:09:04.642936 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-22e3ebd9-945f-47e5-8236-33c76b04e6fb tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:09:04.651311 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-22e3ebd9-945f-47e5-8236-33c76b04e6fb tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:09:04.652847 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-22e3ebd9-945f-47e5-8236-33c76b04e6fb tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:09:04.654053 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-22e3ebd9-945f-47e5-8236-33c76b04e6fb tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] 10.222.0.43 "GET /compute/v2.1/servers/4e4c90a0-14de-401e-80d5-fe4bf684d991" status: 200 len: 1723 microversion: 2.20 time: 0.175842 Jun 29 08:09:04.654624 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 346/680] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 29 08:09:04 2022] GET /compute/v2.1/servers/4e4c90a0-14de-401e-80d5-fe4bf684d991 => generated 1723 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:09:04.817664 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-dab1c0f8-0ab2-4ec5-97c7-e3b20d943c53 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "27d71fab-c12a-46d8-af54-7d9d938a8b1d"}} {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:09:04.818785 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-dab1c0f8-0ab2-4ec5-97c7-e3b20d943c53 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] [instance: d7e8f0a8-6cfe-4b0e-818a-a078672dbd87] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:09:04.825407 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-dab1c0f8-0ab2-4ec5-97c7-e3b20d943c53 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:09:04.825865 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-dab1c0f8-0ab2-4ec5-97c7-e3b20d943c53 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:09:04.826650 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-dab1c0f8-0ab2-4ec5-97c7-e3b20d943c53 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:09:04.827089 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-dab1c0f8-0ab2-4ec5-97c7-e3b20d943c53 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:09:05.124269 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-dab1c0f8-0ab2-4ec5-97c7-e3b20d943c53 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] 10.222.0.43 "POST /compute/v2.1/servers/d7e8f0a8-6cfe-4b0e-818a-a078672dbd87/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.310618 Jun 29 08:09:05.125130 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 335/681] 10.222.0.43 () {60 vars in 1322 bytes} [Wed Jun 29 08:09:04 2022] POST /compute/v2.1/servers/d7e8f0a8-6cfe-4b0e-818a-a078672dbd87/os-volume_attachments => generated 194 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 29 08:09:05.303546 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-a64e25ad-3461-4322-9aa9-eab14f895069 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:09:05.304161 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-a64e25ad-3461-4322-9aa9-eab14f895069 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] [instance: 57b6d980-40de-4505-a591-20b54645d37c] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:09:05.311925 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-a64e25ad-3461-4322-9aa9-eab14f895069 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:09:05.313272 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-a64e25ad-3461-4322-9aa9-eab14f895069 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:09:05.314283 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-a64e25ad-3461-4322-9aa9-eab14f895069 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:09:05.314884 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-a64e25ad-3461-4322-9aa9-eab14f895069 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:09:05.463244 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-a64e25ad-3461-4322-9aa9-eab14f895069 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4873db0f2fbf4a77a617f2102a5ccfae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4df15f6a6dd45dab12d0b724076a23e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:09:05.473627 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-a64e25ad-3461-4322-9aa9-eab14f895069 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] 10.222.0.43 "GET /compute/v2.1/servers/57b6d980-40de-4505-a591-20b54645d37c" status: 200 len: 1367 microversion: 2.1 time: 0.174057 Jun 29 08:09:05.474224 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 347/682] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:09:05 2022] GET /compute/v2.1/servers/57b6d980-40de-4505-a591-20b54645d37c => generated 1367 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:09:05.674816 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-91bd799b-e77e-49f9-922e-0e134e340b7a tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:09:05.675821 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-91bd799b-e77e-49f9-922e-0e134e340b7a tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] [instance: 4e4c90a0-14de-401e-80d5-fe4bf684d991] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:09:05.682739 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-91bd799b-e77e-49f9-922e-0e134e340b7a tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:09:05.683189 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-91bd799b-e77e-49f9-922e-0e134e340b7a tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:09:05.683967 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-91bd799b-e77e-49f9-922e-0e134e340b7a tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:09:05.684398 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-91bd799b-e77e-49f9-922e-0e134e340b7a tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:09:05.835035 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-91bd799b-e77e-49f9-922e-0e134e340b7a tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:09:05.843666 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-91bd799b-e77e-49f9-922e-0e134e340b7a tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:09:05.845223 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-91bd799b-e77e-49f9-922e-0e134e340b7a tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:09:05.846409 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-91bd799b-e77e-49f9-922e-0e134e340b7a tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] 10.222.0.43 "GET /compute/v2.1/servers/4e4c90a0-14de-401e-80d5-fe4bf684d991" status: 200 len: 1723 microversion: 2.20 time: 0.176965 Jun 29 08:09:05.846975 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 336/683] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 29 08:09:05 2022] GET /compute/v2.1/servers/4e4c90a0-14de-401e-80d5-fe4bf684d991 => generated 1723 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 29 08:09:06.494982 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-57e91514-0590-4fb3-8686-d6533b5e6325 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:09:06.495648 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-57e91514-0590-4fb3-8686-d6533b5e6325 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] [instance: 57b6d980-40de-4505-a591-20b54645d37c] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:09:06.503191 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-57e91514-0590-4fb3-8686-d6533b5e6325 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:09:06.503643 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-57e91514-0590-4fb3-8686-d6533b5e6325 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:09:06.504427 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-57e91514-0590-4fb3-8686-d6533b5e6325 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:09:06.504871 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-57e91514-0590-4fb3-8686-d6533b5e6325 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:09:06.652868 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-57e91514-0590-4fb3-8686-d6533b5e6325 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4873db0f2fbf4a77a617f2102a5ccfae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4df15f6a6dd45dab12d0b724076a23e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:09:06.661205 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-57e91514-0590-4fb3-8686-d6533b5e6325 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] 10.222.0.43 "GET /compute/v2.1/servers/57b6d980-40de-4505-a591-20b54645d37c" status: 200 len: 1367 microversion: 2.1 time: 0.172213 Jun 29 08:09:06.661789 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 348/684] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:09:06 2022] GET /compute/v2.1/servers/57b6d980-40de-4505-a591-20b54645d37c => generated 1367 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:09:06.865808 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-cd9e5b43-1b53-4450-b499-cdac65cda58d tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:09:06.866425 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-cd9e5b43-1b53-4450-b499-cdac65cda58d tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] [instance: 4e4c90a0-14de-401e-80d5-fe4bf684d991] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:09:06.873109 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-cd9e5b43-1b53-4450-b499-cdac65cda58d tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:09:06.873555 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-cd9e5b43-1b53-4450-b499-cdac65cda58d tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:09:06.874321 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-cd9e5b43-1b53-4450-b499-cdac65cda58d tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:09:06.875274 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-cd9e5b43-1b53-4450-b499-cdac65cda58d tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:09:07.019883 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-cd9e5b43-1b53-4450-b499-cdac65cda58d tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:09:07.029320 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-cd9e5b43-1b53-4450-b499-cdac65cda58d tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:09:07.031706 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-cd9e5b43-1b53-4450-b499-cdac65cda58d tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:09:07.032919 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-cd9e5b43-1b53-4450-b499-cdac65cda58d tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] 10.222.0.43 "GET /compute/v2.1/servers/4e4c90a0-14de-401e-80d5-fe4bf684d991" status: 200 len: 1723 microversion: 2.20 time: 0.171708 Jun 29 08:09:07.033502 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 337/685] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 29 08:09:06 2022] GET /compute/v2.1/servers/4e4c90a0-14de-401e-80d5-fe4bf684d991 => generated 1723 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:09:07.130455 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [req-fdb7253a-e8b0-4242-8d11-27cd294387c5 req-722e772d-e2b4-4c9b-88c4-fcc7d89d9a81 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "57b6d980-40de-4505-a591-20b54645d37c", "name": "network-vif-plugged", "status": "completed", "tag": "ef9d6628-7dec-44df-ae2b-420055caab1c"}]} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:09:07.143944 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-fdb7253a-e8b0-4242-8d11-27cd294387c5 req-722e772d-e2b4-4c9b-88c4-fcc7d89d9a81 service nova] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:09:07.143944 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-fdb7253a-e8b0-4242-8d11-27cd294387c5 req-722e772d-e2b4-4c9b-88c4-fcc7d89d9a81 service nova] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:09:07.155001 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.compute.server_external_events [req-fdb7253a-e8b0-4242-8d11-27cd294387c5 req-722e772d-e2b4-4c9b-88c4-fcc7d89d9a81 service nova] Creating event network-vif-plugged:ef9d6628-7dec-44df-ae2b-420055caab1c for instance 57b6d980-40de-4505-a591-20b54645d37c on hv-cinder-76810 Jun 29 08:09:07.161496 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [req-fdb7253a-e8b0-4242-8d11-27cd294387c5 req-722e772d-e2b4-4c9b-88c4-fcc7d89d9a81 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095663 Jun 29 08:09:07.162107 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 349/686] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jun 29 08:09:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:09:07.678638 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-d494f15f-12de-492a-b0ef-506f1336f55c tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:09:07.679253 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-d494f15f-12de-492a-b0ef-506f1336f55c tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] [instance: 57b6d980-40de-4505-a591-20b54645d37c] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:09:07.686083 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-d494f15f-12de-492a-b0ef-506f1336f55c tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:09:07.686533 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-d494f15f-12de-492a-b0ef-506f1336f55c tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:09:07.688385 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-d494f15f-12de-492a-b0ef-506f1336f55c tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:09:07.688847 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-d494f15f-12de-492a-b0ef-506f1336f55c tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:09:07.842677 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-d494f15f-12de-492a-b0ef-506f1336f55c tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4873db0f2fbf4a77a617f2102a5ccfae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4df15f6a6dd45dab12d0b724076a23e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:09:07.851079 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-d494f15f-12de-492a-b0ef-506f1336f55c tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] 10.222.0.43 "GET /compute/v2.1/servers/57b6d980-40de-4505-a591-20b54645d37c" status: 200 len: 1367 microversion: 2.1 time: 0.176661 Jun 29 08:09:07.851650 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 338/687] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:09:07 2022] GET /compute/v2.1/servers/57b6d980-40de-4505-a591-20b54645d37c => generated 1367 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:09:08.056576 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-537ce0ba-c48c-46b7-a4f7-a72a09f793cb tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:09:08.057877 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-537ce0ba-c48c-46b7-a4f7-a72a09f793cb tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] [instance: 4e4c90a0-14de-401e-80d5-fe4bf684d991] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:09:08.067898 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-537ce0ba-c48c-46b7-a4f7-a72a09f793cb tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:09:08.068345 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-537ce0ba-c48c-46b7-a4f7-a72a09f793cb tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:09:08.069184 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-537ce0ba-c48c-46b7-a4f7-a72a09f793cb tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:09:08.069632 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-537ce0ba-c48c-46b7-a4f7-a72a09f793cb tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:09:08.072623 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:09:08.223748 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-537ce0ba-c48c-46b7-a4f7-a72a09f793cb tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:09:08.232181 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-537ce0ba-c48c-46b7-a4f7-a72a09f793cb tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:09:08.233727 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-537ce0ba-c48c-46b7-a4f7-a72a09f793cb tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:09:08.236652 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-537ce0ba-c48c-46b7-a4f7-a72a09f793cb tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] 10.222.0.43 "GET /compute/v2.1/servers/4e4c90a0-14de-401e-80d5-fe4bf684d991" status: 200 len: 1723 microversion: 2.20 time: 0.188241 Jun 29 08:09:08.237280 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 350/688] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 29 08:09:08 2022] GET /compute/v2.1/servers/4e4c90a0-14de-401e-80d5-fe4bf684d991 => generated 1723 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:09:08.868120 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-2e35471e-db58-45ea-a3ee-bbda82440a9a tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:09:08.868814 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-2e35471e-db58-45ea-a3ee-bbda82440a9a tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] [instance: 57b6d980-40de-4505-a591-20b54645d37c] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:09:08.875344 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-2e35471e-db58-45ea-a3ee-bbda82440a9a tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:09:08.875791 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-2e35471e-db58-45ea-a3ee-bbda82440a9a tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:09:08.876555 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-2e35471e-db58-45ea-a3ee-bbda82440a9a tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:09:08.877008 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-2e35471e-db58-45ea-a3ee-bbda82440a9a tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:09:09.028964 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-2e35471e-db58-45ea-a3ee-bbda82440a9a tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4873db0f2fbf4a77a617f2102a5ccfae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4df15f6a6dd45dab12d0b724076a23e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:09:09.039042 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-2e35471e-db58-45ea-a3ee-bbda82440a9a tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] 10.222.0.43 "GET /compute/v2.1/servers/57b6d980-40de-4505-a591-20b54645d37c" status: 200 len: 1556 microversion: 2.1 time: 0.174955 Jun 29 08:09:09.039633 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 339/689] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:09:08 2022] GET /compute/v2.1/servers/57b6d980-40de-4505-a591-20b54645d37c => generated 1556 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:09:09.056197 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-aab95f80-5b06-4929-bc2d-2c8c6fe7eef8 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:09:09.056831 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-aab95f80-5b06-4929-bc2d-2c8c6fe7eef8 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] [instance: 57b6d980-40de-4505-a591-20b54645d37c] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:09:09.065405 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-aab95f80-5b06-4929-bc2d-2c8c6fe7eef8 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:09:09.065940 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-aab95f80-5b06-4929-bc2d-2c8c6fe7eef8 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:09:09.066733 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-aab95f80-5b06-4929-bc2d-2c8c6fe7eef8 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:09:09.067166 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-aab95f80-5b06-4929-bc2d-2c8c6fe7eef8 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:09:09.094955 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_cell0:SELECT=2 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:09:09.115185 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_cell0:SELECT=10 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:09:09.153467 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-aab95f80-5b06-4929-bc2d-2c8c6fe7eef8 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] 10.222.0.43 "GET /compute/v2.1/servers/57b6d980-40de-4505-a591-20b54645d37c/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.101450 Jun 29 08:09:09.154065 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 351/690] 10.222.0.43 () {58 vars in 1274 bytes} [Wed Jun 29 08:09:09 2022] GET /compute/v2.1/servers/57b6d980-40de-4505-a591-20b54645d37c/os-interface => generated 284 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:09:09.255816 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-5df08224-fc07-44d7-babe-c89febc52a90 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:09:09.256432 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-5df08224-fc07-44d7-babe-c89febc52a90 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] [instance: 4e4c90a0-14de-401e-80d5-fe4bf684d991] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:09:09.262900 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-5df08224-fc07-44d7-babe-c89febc52a90 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:09:09.263350 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-5df08224-fc07-44d7-babe-c89febc52a90 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:09:09.264138 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-5df08224-fc07-44d7-babe-c89febc52a90 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:09:09.264614 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-5df08224-fc07-44d7-babe-c89febc52a90 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:09:09.305565 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG dbcounter [-] [117890] Writing DB stats nova_cell0:SELECT=2 {{(pid=117890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:09:09.420024 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-5df08224-fc07-44d7-babe-c89febc52a90 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:09:09.432145 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-5df08224-fc07-44d7-babe-c89febc52a90 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:09:09.435240 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-5df08224-fc07-44d7-babe-c89febc52a90 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:09:09.436827 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-5df08224-fc07-44d7-babe-c89febc52a90 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] 10.222.0.43 "GET /compute/v2.1/servers/4e4c90a0-14de-401e-80d5-fe4bf684d991" status: 200 len: 1723 microversion: 2.20 time: 0.184835 Jun 29 08:09:09.438728 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 340/691] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 29 08:09:09 2022] GET /compute/v2.1/servers/4e4c90a0-14de-401e-80d5-fe4bf684d991 => generated 1723 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:09:10.198454 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [req-921230b0-916a-4e05-9ffe-62b881828abe req-76fd9db8-c3b4-4f6d-b7fe-1496b71720b0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "57b6d980-40de-4505-a591-20b54645d37c", "tag": "ef9d6628-7dec-44df-ae2b-420055caab1c"}]} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:09:10.207863 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-921230b0-916a-4e05-9ffe-62b881828abe req-76fd9db8-c3b4-4f6d-b7fe-1496b71720b0 service nova] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:09:10.208317 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-921230b0-916a-4e05-9ffe-62b881828abe req-76fd9db8-c3b4-4f6d-b7fe-1496b71720b0 service nova] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:09:10.220517 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.compute.server_external_events [req-921230b0-916a-4e05-9ffe-62b881828abe req-76fd9db8-c3b4-4f6d-b7fe-1496b71720b0 service nova] Creating event network-changed:ef9d6628-7dec-44df-ae2b-420055caab1c for instance 57b6d980-40de-4505-a591-20b54645d37c on hv-cinder-76810 Jun 29 08:09:10.225569 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [req-921230b0-916a-4e05-9ffe-62b881828abe req-76fd9db8-c3b4-4f6d-b7fe-1496b71720b0 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094491 Jun 29 08:09:10.226194 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 352/692] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jun 29 08:09:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 29 08:09:10.456852 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-1c1ad65c-afb0-4f54-be32-aa858ab52c6a tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:09:10.458442 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-1c1ad65c-afb0-4f54-be32-aa858ab52c6a tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] [instance: 4e4c90a0-14de-401e-80d5-fe4bf684d991] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:09:10.466525 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-1c1ad65c-afb0-4f54-be32-aa858ab52c6a tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:09:10.468038 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-1c1ad65c-afb0-4f54-be32-aa858ab52c6a tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:09:10.469846 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-1c1ad65c-afb0-4f54-be32-aa858ab52c6a tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:09:10.470562 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-1c1ad65c-afb0-4f54-be32-aa858ab52c6a tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:09:10.765855 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-1c1ad65c-afb0-4f54-be32-aa858ab52c6a tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:09:10.778360 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-1c1ad65c-afb0-4f54-be32-aa858ab52c6a tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:09:10.782221 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-1c1ad65c-afb0-4f54-be32-aa858ab52c6a tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:09:10.785043 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-1c1ad65c-afb0-4f54-be32-aa858ab52c6a tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] 10.222.0.43 "GET /compute/v2.1/servers/4e4c90a0-14de-401e-80d5-fe4bf684d991" status: 200 len: 1723 microversion: 2.20 time: 0.331889 Jun 29 08:09:10.786173 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 341/693] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 29 08:09:10 2022] GET /compute/v2.1/servers/4e4c90a0-14de-401e-80d5-fe4bf684d991 => generated 1723 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:09:11.808440 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-c0e7f0a9-54de-425d-9d45-4b4bb9f905d1 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:09:11.809176 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-c0e7f0a9-54de-425d-9d45-4b4bb9f905d1 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] [instance: 4e4c90a0-14de-401e-80d5-fe4bf684d991] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:09:11.817564 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c0e7f0a9-54de-425d-9d45-4b4bb9f905d1 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:09:11.818017 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c0e7f0a9-54de-425d-9d45-4b4bb9f905d1 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:09:11.818793 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c0e7f0a9-54de-425d-9d45-4b4bb9f905d1 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:09:11.819232 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c0e7f0a9-54de-425d-9d45-4b4bb9f905d1 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:09:11.977162 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-c0e7f0a9-54de-425d-9d45-4b4bb9f905d1 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:09:11.986246 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-c0e7f0a9-54de-425d-9d45-4b4bb9f905d1 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:09:11.987765 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-c0e7f0a9-54de-425d-9d45-4b4bb9f905d1 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:09:11.989005 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-c0e7f0a9-54de-425d-9d45-4b4bb9f905d1 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] 10.222.0.43 "GET /compute/v2.1/servers/4e4c90a0-14de-401e-80d5-fe4bf684d991" status: 200 len: 1723 microversion: 2.20 time: 0.184957 Jun 29 08:09:11.989578 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 353/694] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 29 08:09:11 2022] GET /compute/v2.1/servers/4e4c90a0-14de-401e-80d5-fe4bf684d991 => generated 1723 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:09:12.680055 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-807bf8f8-ee68-478d-9b3a-89e4c777060a tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:09:12.681081 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-807bf8f8-ee68-478d-9b3a-89e4c777060a tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] [instance: d7e8f0a8-6cfe-4b0e-818a-a078672dbd87] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:09:12.688378 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-807bf8f8-ee68-478d-9b3a-89e4c777060a tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:09:12.688842 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-807bf8f8-ee68-478d-9b3a-89e4c777060a tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:09:12.689632 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-807bf8f8-ee68-478d-9b3a-89e4c777060a tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:09:12.690063 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-807bf8f8-ee68-478d-9b3a-89e4c777060a tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:09:12.725417 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-807bf8f8-ee68-478d-9b3a-89e4c777060a tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] 10.222.0.43 "GET /compute/v2.1/servers/d7e8f0a8-6cfe-4b0e-818a-a078672dbd87/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.049159 Jun 29 08:09:12.726004 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 342/695] 10.222.0.43 () {58 vars in 1301 bytes} [Wed Jun 29 08:09:12 2022] GET /compute/v2.1/servers/d7e8f0a8-6cfe-4b0e-818a-a078672dbd87/os-volume_attachments => generated 371 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:09:12.864771 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-d4fc5b6c-7398-4333-89a2-2a76c71446d8 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:09:12.865715 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-d4fc5b6c-7398-4333-89a2-2a76c71446d8 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] [instance: d7e8f0a8-6cfe-4b0e-818a-a078672dbd87] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:09:12.872943 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-d4fc5b6c-7398-4333-89a2-2a76c71446d8 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:09:12.873426 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-d4fc5b6c-7398-4333-89a2-2a76c71446d8 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:09:12.874200 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-d4fc5b6c-7398-4333-89a2-2a76c71446d8 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:09:12.874726 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-d4fc5b6c-7398-4333-89a2-2a76c71446d8 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:09:12.903720 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-d4fc5b6c-7398-4333-89a2-2a76c71446d8 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] 10.222.0.43 "GET /compute/v2.1/servers/d7e8f0a8-6cfe-4b0e-818a-a078672dbd87/os-volume_attachments/48f16aa2-33f8-4a69-8943-03964d0855a2" status: 200 len: 194 microversion: 2.1 time: 0.046150 Jun 29 08:09:12.904244 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 354/696] 10.222.0.43 () {58 vars in 1412 bytes} [Wed Jun 29 08:09:12 2022] GET /compute/v2.1/servers/d7e8f0a8-6cfe-4b0e-818a-a078672dbd87/os-volume_attachments/48f16aa2-33f8-4a69-8943-03964d0855a2 => generated 194 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:09:12.914937 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-f70aa4cb-4b70-4320-aea7-3ee2726681e2 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:09:12.915424 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-f70aa4cb-4b70-4320-aea7-3ee2726681e2 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] [instance: d7e8f0a8-6cfe-4b0e-818a-a078672dbd87] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:09:12.922111 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-f70aa4cb-4b70-4320-aea7-3ee2726681e2 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:09:12.922567 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-f70aa4cb-4b70-4320-aea7-3ee2726681e2 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:09:12.923329 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-f70aa4cb-4b70-4320-aea7-3ee2726681e2 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:09:12.923756 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-f70aa4cb-4b70-4320-aea7-3ee2726681e2 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:09:13.007969 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-e221a929-324b-4406-8899-9f6a5da15e82 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:09:13.008574 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-e221a929-324b-4406-8899-9f6a5da15e82 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] [instance: 4e4c90a0-14de-401e-80d5-fe4bf684d991] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:09:13.011107 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.objects.instance [None req-f70aa4cb-4b70-4320-aea7-3ee2726681e2 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lazy-loading 'services' on Instance uuid d7e8f0a8-6cfe-4b0e-818a-a078672dbd87 {{(pid=117890) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 29 08:09:13.014543 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e221a929-324b-4406-8899-9f6a5da15e82 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:09:13.014990 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e221a929-324b-4406-8899-9f6a5da15e82 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:09:13.015764 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e221a929-324b-4406-8899-9f6a5da15e82 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:09:13.016200 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e221a929-324b-4406-8899-9f6a5da15e82 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:09:13.096803 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-f70aa4cb-4b70-4320-aea7-3ee2726681e2 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] 10.222.0.43 "DELETE /compute/v2.1/servers/d7e8f0a8-6cfe-4b0e-818a-a078672dbd87/os-volume_attachments/48f16aa2-33f8-4a69-8943-03964d0855a2" status: 202 len: 0 microversion: 2.1 time: 0.185864 Jun 29 08:09:13.097464 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 343/697] 10.222.0.43 () {58 vars in 1415 bytes} [Wed Jun 29 08:09:12 2022] DELETE /compute/v2.1/servers/d7e8f0a8-6cfe-4b0e-818a-a078672dbd87/os-volume_attachments/48f16aa2-33f8-4a69-8943-03964d0855a2 => generated 0 bytes in 187 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 29 08:09:13.177756 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-e221a929-324b-4406-8899-9f6a5da15e82 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:09:13.188010 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-e221a929-324b-4406-8899-9f6a5da15e82 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:09:13.189611 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-e221a929-324b-4406-8899-9f6a5da15e82 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:09:13.190799 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-e221a929-324b-4406-8899-9f6a5da15e82 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] 10.222.0.43 "GET /compute/v2.1/servers/4e4c90a0-14de-401e-80d5-fe4bf684d991" status: 200 len: 1723 microversion: 2.20 time: 0.186786 Jun 29 08:09:13.191359 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 355/698] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 29 08:09:13 2022] GET /compute/v2.1/servers/4e4c90a0-14de-401e-80d5-fe4bf684d991 => generated 1723 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 29 08:09:14.212466 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-f4b23b09-daf5-4ad2-814a-1f037c4582b4 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:09:14.213867 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-f4b23b09-daf5-4ad2-814a-1f037c4582b4 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] [instance: 4e4c90a0-14de-401e-80d5-fe4bf684d991] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:09:14.224724 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-f4b23b09-daf5-4ad2-814a-1f037c4582b4 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:09:14.224724 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-f4b23b09-daf5-4ad2-814a-1f037c4582b4 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:09:14.224724 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-f4b23b09-daf5-4ad2-814a-1f037c4582b4 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:09:14.224724 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-f4b23b09-daf5-4ad2-814a-1f037c4582b4 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:09:14.381074 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-f4b23b09-daf5-4ad2-814a-1f037c4582b4 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:09:14.389551 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-f4b23b09-daf5-4ad2-814a-1f037c4582b4 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:09:14.391371 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-f4b23b09-daf5-4ad2-814a-1f037c4582b4 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:09:14.392580 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-f4b23b09-daf5-4ad2-814a-1f037c4582b4 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] 10.222.0.43 "GET /compute/v2.1/servers/4e4c90a0-14de-401e-80d5-fe4bf684d991" status: 200 len: 1723 microversion: 2.20 time: 0.186050 Jun 29 08:09:14.393166 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 344/699] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 29 08:09:14 2022] GET /compute/v2.1/servers/4e4c90a0-14de-401e-80d5-fe4bf684d991 => generated 1723 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:09:15.297013 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-49ab3b72-0a9a-461c-a8e0-2b5eba559ec9 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:09:15.297604 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-49ab3b72-0a9a-461c-a8e0-2b5eba559ec9 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] [instance: d7e8f0a8-6cfe-4b0e-818a-a078672dbd87] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:09:15.304970 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-49ab3b72-0a9a-461c-a8e0-2b5eba559ec9 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:09:15.305455 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-49ab3b72-0a9a-461c-a8e0-2b5eba559ec9 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:09:15.306248 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-49ab3b72-0a9a-461c-a8e0-2b5eba559ec9 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:09:15.306687 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-49ab3b72-0a9a-461c-a8e0-2b5eba559ec9 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:09:15.341061 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-49ab3b72-0a9a-461c-a8e0-2b5eba559ec9 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] 10.222.0.43 "GET /compute/v2.1/servers/d7e8f0a8-6cfe-4b0e-818a-a078672dbd87/os-volume_attachments/27d71fab-c12a-46d8-af54-7d9d938a8b1d" status: 200 len: 194 microversion: 2.1 time: 0.046281 Jun 29 08:09:15.341061 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 356/700] 10.222.0.43 () {58 vars in 1412 bytes} [Wed Jun 29 08:09:15 2022] GET /compute/v2.1/servers/d7e8f0a8-6cfe-4b0e-818a-a078672dbd87/os-volume_attachments/27d71fab-c12a-46d8-af54-7d9d938a8b1d => generated 194 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:09:15.355450 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-59464fc9-5c28-405f-b095-6b830422ea4b tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:09:15.356015 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-59464fc9-5c28-405f-b095-6b830422ea4b tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] [instance: d7e8f0a8-6cfe-4b0e-818a-a078672dbd87] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:09:15.363021 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-59464fc9-5c28-405f-b095-6b830422ea4b tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:09:15.363482 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-59464fc9-5c28-405f-b095-6b830422ea4b tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:09:15.364283 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-59464fc9-5c28-405f-b095-6b830422ea4b tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:09:15.364731 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-59464fc9-5c28-405f-b095-6b830422ea4b tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:09:15.420520 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-a2ffc838-074b-4fea-be84-93ecc000dfd0 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:09:15.421866 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-a2ffc838-074b-4fea-be84-93ecc000dfd0 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] [instance: 4e4c90a0-14de-401e-80d5-fe4bf684d991] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:09:15.430668 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-a2ffc838-074b-4fea-be84-93ecc000dfd0 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:09:15.431198 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-a2ffc838-074b-4fea-be84-93ecc000dfd0 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:09:15.432174 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-a2ffc838-074b-4fea-be84-93ecc000dfd0 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:09:15.432617 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-a2ffc838-074b-4fea-be84-93ecc000dfd0 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:09:15.485441 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.objects.instance [None req-59464fc9-5c28-405f-b095-6b830422ea4b tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lazy-loading 'services' on Instance uuid d7e8f0a8-6cfe-4b0e-818a-a078672dbd87 {{(pid=117890) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 29 08:09:15.574171 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-59464fc9-5c28-405f-b095-6b830422ea4b tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] 10.222.0.43 "DELETE /compute/v2.1/servers/d7e8f0a8-6cfe-4b0e-818a-a078672dbd87/os-volume_attachments/27d71fab-c12a-46d8-af54-7d9d938a8b1d" status: 202 len: 0 microversion: 2.1 time: 0.222384 Jun 29 08:09:15.574997 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 345/701] 10.222.0.43 () {58 vars in 1415 bytes} [Wed Jun 29 08:09:15 2022] DELETE /compute/v2.1/servers/d7e8f0a8-6cfe-4b0e-818a-a078672dbd87/os-volume_attachments/27d71fab-c12a-46d8-af54-7d9d938a8b1d => generated 0 bytes in 224 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 29 08:09:15.584061 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-a2ffc838-074b-4fea-be84-93ecc000dfd0 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:09:15.597827 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-a2ffc838-074b-4fea-be84-93ecc000dfd0 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:09:15.601023 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-a2ffc838-074b-4fea-be84-93ecc000dfd0 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:09:15.603299 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-a2ffc838-074b-4fea-be84-93ecc000dfd0 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] 10.222.0.43 "GET /compute/v2.1/servers/4e4c90a0-14de-401e-80d5-fe4bf684d991" status: 200 len: 1744 microversion: 2.20 time: 0.194735 Jun 29 08:09:15.604220 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 357/702] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 29 08:09:15 2022] GET /compute/v2.1/servers/4e4c90a0-14de-401e-80d5-fe4bf684d991 => generated 1744 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:09:15.613154 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-2e961ffc-70ab-4214-8027-5d6f444c3751 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:09:15.614307 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-2e961ffc-70ab-4214-8027-5d6f444c3751 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] [instance: 83a86ef0-c066-44a7-b4eb-e32dce6e0069] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:09:15.627035 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-2e961ffc-70ab-4214-8027-5d6f444c3751 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:09:15.627566 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-2e961ffc-70ab-4214-8027-5d6f444c3751 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:09:15.628468 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-2e961ffc-70ab-4214-8027-5d6f444c3751 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:09:15.629167 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-2e961ffc-70ab-4214-8027-5d6f444c3751 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:09:15.657633 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.objects.instance [None req-2e961ffc-70ab-4214-8027-5d6f444c3751 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Lazy-loading 'flavor' on Instance uuid 83a86ef0-c066-44a7-b4eb-e32dce6e0069 {{(pid=117890) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 29 08:09:15.707269 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG dbcounter [-] [117890] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=117890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:09:15.738378 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-2e961ffc-70ab-4214-8027-5d6f444c3751 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] 10.222.0.43 "POST /compute/v2.1/servers/83a86ef0-c066-44a7-b4eb-e32dce6e0069/action" status: 202 len: 0 microversion: 2.1 time: 0.137784 Jun 29 08:09:15.738378 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 346/703] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Jun 29 08:09:15 2022] POST /compute/v2.1/servers/83a86ef0-c066-44a7-b4eb-e32dce6e0069/action => generated 0 bytes in 141 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 29 08:09:15.746183 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-1d8f6ca9-9408-4871-80d1-f1809e290bf7 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:09:15.746806 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-1d8f6ca9-9408-4871-80d1-f1809e290bf7 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] [instance: 83a86ef0-c066-44a7-b4eb-e32dce6e0069] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:09:15.754094 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-1d8f6ca9-9408-4871-80d1-f1809e290bf7 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:09:15.754540 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-1d8f6ca9-9408-4871-80d1-f1809e290bf7 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:09:15.755343 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-1d8f6ca9-9408-4871-80d1-f1809e290bf7 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:09:15.755776 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-1d8f6ca9-9408-4871-80d1-f1809e290bf7 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:09:15.917820 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-1d8f6ca9-9408-4871-80d1-f1809e290bf7 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de6636a0522642799e43a8f02ee602ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a20f6f9f254aae91c952ee44a4ff74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:09:15.926090 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-1d8f6ca9-9408-4871-80d1-f1809e290bf7 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] 10.222.0.43 "GET /compute/v2.1/servers/83a86ef0-c066-44a7-b4eb-e32dce6e0069" status: 200 len: 1570 microversion: 2.1 time: 0.183715 Jun 29 08:09:15.926682 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 358/704] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:09:15 2022] GET /compute/v2.1/servers/83a86ef0-c066-44a7-b4eb-e32dce6e0069 => generated 1570 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:09:16.633418 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-e2daa5a8-a3b6-4fdf-9022-5f0425e4d2ef tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:09:16.634400 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-e2daa5a8-a3b6-4fdf-9022-5f0425e4d2ef tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] [instance: 4e4c90a0-14de-401e-80d5-fe4bf684d991] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:09:16.644992 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-e2daa5a8-a3b6-4fdf-9022-5f0425e4d2ef tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:09:16.645896 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-e2daa5a8-a3b6-4fdf-9022-5f0425e4d2ef tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:09:16.647000 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-e2daa5a8-a3b6-4fdf-9022-5f0425e4d2ef tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:09:16.647827 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-e2daa5a8-a3b6-4fdf-9022-5f0425e4d2ef tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:09:16.832307 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-e2daa5a8-a3b6-4fdf-9022-5f0425e4d2ef tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:09:16.843729 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-e2daa5a8-a3b6-4fdf-9022-5f0425e4d2ef tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:09:16.847264 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-e2daa5a8-a3b6-4fdf-9022-5f0425e4d2ef tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:09:16.850754 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-e2daa5a8-a3b6-4fdf-9022-5f0425e4d2ef tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] 10.222.0.43 "GET /compute/v2.1/servers/4e4c90a0-14de-401e-80d5-fe4bf684d991" status: 200 len: 1739 microversion: 2.20 time: 0.222543 Jun 29 08:09:16.851084 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 347/705] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 29 08:09:16 2022] GET /compute/v2.1/servers/4e4c90a0-14de-401e-80d5-fe4bf684d991 => generated 1739 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:09:16.946255 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-2b2cfba4-66fa-438c-bbec-ce2d8b2e556a tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:09:16.947103 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-2b2cfba4-66fa-438c-bbec-ce2d8b2e556a tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] [instance: 83a86ef0-c066-44a7-b4eb-e32dce6e0069] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:09:16.958582 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-2b2cfba4-66fa-438c-bbec-ce2d8b2e556a tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:09:16.958828 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-2b2cfba4-66fa-438c-bbec-ce2d8b2e556a tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:09:16.959665 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-2b2cfba4-66fa-438c-bbec-ce2d8b2e556a tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:09:16.960114 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-2b2cfba4-66fa-438c-bbec-ce2d8b2e556a tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:09:17.126560 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-2b2cfba4-66fa-438c-bbec-ce2d8b2e556a tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de6636a0522642799e43a8f02ee602ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a20f6f9f254aae91c952ee44a4ff74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:09:17.137229 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-2b2cfba4-66fa-438c-bbec-ce2d8b2e556a tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] 10.222.0.43 "GET /compute/v2.1/servers/83a86ef0-c066-44a7-b4eb-e32dce6e0069" status: 200 len: 1570 microversion: 2.1 time: 0.195768 Jun 29 08:09:17.138391 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 359/706] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:09:16 2022] GET /compute/v2.1/servers/83a86ef0-c066-44a7-b4eb-e32dce6e0069 => generated 1570 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:09:17.158160 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [req-2904adc6-f448-47d0-b49c-ecea4e14e84b req-637b197e-4b01-4263-a6c9-aab9fcef272f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e4c90a0-14de-401e-80d5-fe4bf684d991", "name": "network-vif-plugged", "status": "completed", "tag": "747dea80-5c60-451c-bba1-3aabe38a1272"}]} {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:09:17.177445 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [req-2904adc6-f448-47d0-b49c-ecea4e14e84b req-637b197e-4b01-4263-a6c9-aab9fcef272f service nova] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:09:17.178682 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [req-2904adc6-f448-47d0-b49c-ecea4e14e84b req-637b197e-4b01-4263-a6c9-aab9fcef272f service nova] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:09:17.205361 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.compute.server_external_events [req-2904adc6-f448-47d0-b49c-ecea4e14e84b req-637b197e-4b01-4263-a6c9-aab9fcef272f service nova] Creating event network-vif-plugged:747dea80-5c60-451c-bba1-3aabe38a1272 for instance 4e4c90a0-14de-401e-80d5-fe4bf684d991 on hv-cinder-76810 Jun 29 08:09:17.215258 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [req-2904adc6-f448-47d0-b49c-ecea4e14e84b req-637b197e-4b01-4263-a6c9-aab9fcef272f service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061593 Jun 29 08:09:17.217155 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 348/707] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jun 29 08:09:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:09:17.884478 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-c17abd8a-5c0f-436a-bac8-0b3e704cd84e tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:09:17.885153 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-c17abd8a-5c0f-436a-bac8-0b3e704cd84e tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] [instance: 4e4c90a0-14de-401e-80d5-fe4bf684d991] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:09:17.892420 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c17abd8a-5c0f-436a-bac8-0b3e704cd84e tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:09:17.892971 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c17abd8a-5c0f-436a-bac8-0b3e704cd84e tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:09:17.894081 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c17abd8a-5c0f-436a-bac8-0b3e704cd84e tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:09:17.895017 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c17abd8a-5c0f-436a-bac8-0b3e704cd84e tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:09:17.934484 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-7fe21169-4176-429d-b2ea-f83f7ea486b9 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:09:17.936420 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-7fe21169-4176-429d-b2ea-f83f7ea486b9 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] [instance: d7e8f0a8-6cfe-4b0e-818a-a078672dbd87] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:09:17.949965 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-7fe21169-4176-429d-b2ea-f83f7ea486b9 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:09:17.951304 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-7fe21169-4176-429d-b2ea-f83f7ea486b9 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:09:17.953075 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-7fe21169-4176-429d-b2ea-f83f7ea486b9 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:09:17.954216 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-7fe21169-4176-429d-b2ea-f83f7ea486b9 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:09:18.006754 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-7fe21169-4176-429d-b2ea-f83f7ea486b9 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] 10.222.0.43 "GET /compute/v2.1/servers/d7e8f0a8-6cfe-4b0e-818a-a078672dbd87/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.080455 Jun 29 08:09:18.015313 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 349/708] 10.222.0.43 () {58 vars in 1301 bytes} [Wed Jun 29 08:09:17 2022] GET /compute/v2.1/servers/d7e8f0a8-6cfe-4b0e-818a-a078672dbd87/os-volume_attachments => generated 25 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 29 08:09:18.069901 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-c17abd8a-5c0f-436a-bac8-0b3e704cd84e tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:09:18.081324 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-c17abd8a-5c0f-436a-bac8-0b3e704cd84e tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:09:18.083276 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-c17abd8a-5c0f-436a-bac8-0b3e704cd84e tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:09:18.084836 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-c17abd8a-5c0f-436a-bac8-0b3e704cd84e tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] 10.222.0.43 "GET /compute/v2.1/servers/4e4c90a0-14de-401e-80d5-fe4bf684d991" status: 200 len: 1739 microversion: 2.20 time: 0.207029 Jun 29 08:09:18.095514 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 360/709] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 29 08:09:17 2022] GET /compute/v2.1/servers/4e4c90a0-14de-401e-80d5-fe4bf684d991 => generated 1739 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 29 08:09:18.169026 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-39288f66-3344-439f-9799-722911ed195b tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:09:18.170234 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-39288f66-3344-439f-9799-722911ed195b tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] [instance: 83a86ef0-c066-44a7-b4eb-e32dce6e0069] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:09:18.170410 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-136bac6f-c877-4e35-a252-36f430fc727d tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:09:18.171780 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-136bac6f-c877-4e35-a252-36f430fc727d tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] [instance: d7e8f0a8-6cfe-4b0e-818a-a078672dbd87] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:09:18.180004 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-136bac6f-c877-4e35-a252-36f430fc727d tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:09:18.180782 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-136bac6f-c877-4e35-a252-36f430fc727d tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:09:18.181846 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-136bac6f-c877-4e35-a252-36f430fc727d tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:09:18.182146 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-39288f66-3344-439f-9799-722911ed195b tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:09:18.182705 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-136bac6f-c877-4e35-a252-36f430fc727d tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:09:18.183021 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-39288f66-3344-439f-9799-722911ed195b tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:09:18.184492 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-39288f66-3344-439f-9799-722911ed195b tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:09:18.185550 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-39288f66-3344-439f-9799-722911ed195b tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:09:18.238344 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-136bac6f-c877-4e35-a252-36f430fc727d tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] 10.222.0.43 "GET /compute/v2.1/servers/d7e8f0a8-6cfe-4b0e-818a-a078672dbd87/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.072279 Jun 29 08:09:18.258572 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 361/710] 10.222.0.43 () {58 vars in 1301 bytes} [Wed Jun 29 08:09:18 2022] GET /compute/v2.1/servers/d7e8f0a8-6cfe-4b0e-818a-a078672dbd87/os-volume_attachments => generated 25 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 29 08:09:18.384267 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-e55800ef-26b6-480a-a2ff-652d5050c9f2 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:09:18.385628 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-e55800ef-26b6-480a-a2ff-652d5050c9f2 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] [instance: d7e8f0a8-6cfe-4b0e-818a-a078672dbd87] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:09:18.412443 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e55800ef-26b6-480a-a2ff-652d5050c9f2 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:09:18.413666 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e55800ef-26b6-480a-a2ff-652d5050c9f2 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:09:18.415020 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e55800ef-26b6-480a-a2ff-652d5050c9f2 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:09:18.415801 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e55800ef-26b6-480a-a2ff-652d5050c9f2 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:09:18.418712 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-39288f66-3344-439f-9799-722911ed195b tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de6636a0522642799e43a8f02ee602ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a20f6f9f254aae91c952ee44a4ff74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:09:18.434573 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-39288f66-3344-439f-9799-722911ed195b tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] 10.222.0.43 "GET /compute/v2.1/servers/83a86ef0-c066-44a7-b4eb-e32dce6e0069" status: 200 len: 1570 microversion: 2.1 time: 0.275093 Jun 29 08:09:18.435980 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 350/711] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:09:18 2022] GET /compute/v2.1/servers/83a86ef0-c066-44a7-b4eb-e32dce6e0069 => generated 1570 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:09:18.475352 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-e55800ef-26b6-480a-a2ff-652d5050c9f2 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] [instance: d7e8f0a8-6cfe-4b0e-818a-a078672dbd87] Going to try to terminate instance {{(pid=117889) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 29 08:09:18.626149 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-e55800ef-26b6-480a-a2ff-652d5050c9f2 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] 10.222.0.43 "DELETE /compute/v2.1/servers/d7e8f0a8-6cfe-4b0e-818a-a078672dbd87" status: 204 len: 0 microversion: 2.1 time: 0.248550 Jun 29 08:09:18.632404 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 362/712] 10.222.0.43 () {58 vars in 1238 bytes} [Wed Jun 29 08:09:18 2022] DELETE /compute/v2.1/servers/d7e8f0a8-6cfe-4b0e-818a-a078672dbd87 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 29 08:09:18.638464 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-04ef4a61-878e-4428-8bf6-11175c461359 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:09:18.639185 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-04ef4a61-878e-4428-8bf6-11175c461359 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] [instance: d7e8f0a8-6cfe-4b0e-818a-a078672dbd87] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:09:18.648674 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-04ef4a61-878e-4428-8bf6-11175c461359 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:09:18.649192 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-04ef4a61-878e-4428-8bf6-11175c461359 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:09:18.650026 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-04ef4a61-878e-4428-8bf6-11175c461359 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:09:18.650472 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-04ef4a61-878e-4428-8bf6-11175c461359 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:09:18.839358 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-04ef4a61-878e-4428-8bf6-11175c461359 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c70c44993ab240b1a5231df4c9d550c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e0c37d941434569b3dbd07e22125210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:09:18.858336 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-04ef4a61-878e-4428-8bf6-11175c461359 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] 10.222.0.43 "GET /compute/v2.1/servers/d7e8f0a8-6cfe-4b0e-818a-a078672dbd87" status: 200 len: 1674 microversion: 2.1 time: 0.223839 Jun 29 08:09:18.859974 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 351/713] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:09:18 2022] GET /compute/v2.1/servers/d7e8f0a8-6cfe-4b0e-818a-a078672dbd87 => generated 1674 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:09:19.107603 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-68e6d5b5-ca5e-4aac-988a-7ece547a21db tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:09:19.108409 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-68e6d5b5-ca5e-4aac-988a-7ece547a21db tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] [instance: 4e4c90a0-14de-401e-80d5-fe4bf684d991] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:09:19.119581 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-68e6d5b5-ca5e-4aac-988a-7ece547a21db tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:09:19.120169 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-68e6d5b5-ca5e-4aac-988a-7ece547a21db tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:09:19.121142 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-68e6d5b5-ca5e-4aac-988a-7ece547a21db tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:09:19.122145 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-68e6d5b5-ca5e-4aac-988a-7ece547a21db tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:09:19.342929 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-68e6d5b5-ca5e-4aac-988a-7ece547a21db tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:09:19.358053 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-68e6d5b5-ca5e-4aac-988a-7ece547a21db tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:09:19.360999 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-68e6d5b5-ca5e-4aac-988a-7ece547a21db tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:09:19.362418 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-68e6d5b5-ca5e-4aac-988a-7ece547a21db tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] 10.222.0.43 "GET /compute/v2.1/servers/4e4c90a0-14de-401e-80d5-fe4bf684d991" status: 200 len: 1739 microversion: 2.20 time: 0.259427 Jun 29 08:09:19.363535 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 363/714] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 29 08:09:19 2022] GET /compute/v2.1/servers/4e4c90a0-14de-401e-80d5-fe4bf684d991 => generated 1739 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 29 08:09:19.452238 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-96396f4a-812d-4328-b9ae-c732d42264fe tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:09:19.453531 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-96396f4a-812d-4328-b9ae-c732d42264fe tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] [instance: 83a86ef0-c066-44a7-b4eb-e32dce6e0069] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:09:19.461174 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-96396f4a-812d-4328-b9ae-c732d42264fe tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:09:19.461802 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-96396f4a-812d-4328-b9ae-c732d42264fe tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:09:19.462726 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-96396f4a-812d-4328-b9ae-c732d42264fe tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:09:19.463342 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-96396f4a-812d-4328-b9ae-c732d42264fe tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:09:19.653913 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-96396f4a-812d-4328-b9ae-c732d42264fe tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de6636a0522642799e43a8f02ee602ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a20f6f9f254aae91c952ee44a4ff74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:09:19.664324 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-96396f4a-812d-4328-b9ae-c732d42264fe tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] 10.222.0.43 "GET /compute/v2.1/servers/83a86ef0-c066-44a7-b4eb-e32dce6e0069" status: 200 len: 1570 microversion: 2.1 time: 0.215878 Jun 29 08:09:19.676103 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 352/715] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:09:19 2022] GET /compute/v2.1/servers/83a86ef0-c066-44a7-b4eb-e32dce6e0069 => generated 1570 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:09:19.877932 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-7fc4a910-f4b2-4e91-91cb-7887004da414 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:09:19.878555 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-7fc4a910-f4b2-4e91-91cb-7887004da414 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] [instance: d7e8f0a8-6cfe-4b0e-818a-a078672dbd87] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:09:19.885492 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-7fc4a910-f4b2-4e91-91cb-7887004da414 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:09:19.886064 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-7fc4a910-f4b2-4e91-91cb-7887004da414 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:09:19.886825 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-7fc4a910-f4b2-4e91-91cb-7887004da414 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:09:19.887260 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-7fc4a910-f4b2-4e91-91cb-7887004da414 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:09:20.044382 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-7fc4a910-f4b2-4e91-91cb-7887004da414 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c70c44993ab240b1a5231df4c9d550c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e0c37d941434569b3dbd07e22125210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:09:20.060227 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-7fc4a910-f4b2-4e91-91cb-7887004da414 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] 10.222.0.43 "GET /compute/v2.1/servers/d7e8f0a8-6cfe-4b0e-818a-a078672dbd87" status: 200 len: 1674 microversion: 2.1 time: 0.186704 Jun 29 08:09:20.061323 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 364/716] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:09:19 2022] GET /compute/v2.1/servers/d7e8f0a8-6cfe-4b0e-818a-a078672dbd87 => generated 1674 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:09:20.387725 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-8f30e235-1c2d-4b64-b59f-f0fc96bc0750 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:09:20.388597 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-8f30e235-1c2d-4b64-b59f-f0fc96bc0750 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] [instance: 4e4c90a0-14de-401e-80d5-fe4bf684d991] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:09:20.396157 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-8f30e235-1c2d-4b64-b59f-f0fc96bc0750 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:09:20.396743 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-8f30e235-1c2d-4b64-b59f-f0fc96bc0750 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:09:20.397582 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-8f30e235-1c2d-4b64-b59f-f0fc96bc0750 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:09:20.398069 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-8f30e235-1c2d-4b64-b59f-f0fc96bc0750 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:09:20.590626 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-8f30e235-1c2d-4b64-b59f-f0fc96bc0750 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:09:20.603355 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-8f30e235-1c2d-4b64-b59f-f0fc96bc0750 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:09:20.605498 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-8f30e235-1c2d-4b64-b59f-f0fc96bc0750 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:09:20.607115 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-8f30e235-1c2d-4b64-b59f-f0fc96bc0750 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] 10.222.0.43 "GET /compute/v2.1/servers/4e4c90a0-14de-401e-80d5-fe4bf684d991" status: 200 len: 1739 microversion: 2.20 time: 0.224680 Jun 29 08:09:20.608930 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 353/717] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 29 08:09:20 2022] GET /compute/v2.1/servers/4e4c90a0-14de-401e-80d5-fe4bf684d991 => generated 1739 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:09:20.687443 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-bffdd05f-522b-47b5-b609-c2fcb1d3c2fd tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:09:20.689963 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-bffdd05f-522b-47b5-b609-c2fcb1d3c2fd tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] [instance: 83a86ef0-c066-44a7-b4eb-e32dce6e0069] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:09:20.709566 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-bffdd05f-522b-47b5-b609-c2fcb1d3c2fd tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:09:20.716159 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-bffdd05f-522b-47b5-b609-c2fcb1d3c2fd tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:09:20.718448 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-bffdd05f-522b-47b5-b609-c2fcb1d3c2fd tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:09:20.719405 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-bffdd05f-522b-47b5-b609-c2fcb1d3c2fd tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:09:20.935794 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-bffdd05f-522b-47b5-b609-c2fcb1d3c2fd tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de6636a0522642799e43a8f02ee602ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a20f6f9f254aae91c952ee44a4ff74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:09:20.947564 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-bffdd05f-522b-47b5-b609-c2fcb1d3c2fd tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] 10.222.0.43 "GET /compute/v2.1/servers/83a86ef0-c066-44a7-b4eb-e32dce6e0069" status: 200 len: 1570 microversion: 2.1 time: 0.267186 Jun 29 08:09:20.948456 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 365/718] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:09:20 2022] GET /compute/v2.1/servers/83a86ef0-c066-44a7-b4eb-e32dce6e0069 => generated 1570 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:09:21.087952 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-d9c08e2e-a765-43f6-bc50-8fb88e455eb5 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:09:21.088816 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-d9c08e2e-a765-43f6-bc50-8fb88e455eb5 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] [instance: d7e8f0a8-6cfe-4b0e-818a-a078672dbd87] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:09:21.098110 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-d9c08e2e-a765-43f6-bc50-8fb88e455eb5 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:09:21.098806 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-d9c08e2e-a765-43f6-bc50-8fb88e455eb5 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:09:21.099668 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-d9c08e2e-a765-43f6-bc50-8fb88e455eb5 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:09:21.100184 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-d9c08e2e-a765-43f6-bc50-8fb88e455eb5 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:09:21.390925 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-d9c08e2e-a765-43f6-bc50-8fb88e455eb5 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c70c44993ab240b1a5231df4c9d550c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e0c37d941434569b3dbd07e22125210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:09:21.420009 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-d9c08e2e-a765-43f6-bc50-8fb88e455eb5 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] 10.222.0.43 "GET /compute/v2.1/servers/d7e8f0a8-6cfe-4b0e-818a-a078672dbd87" status: 200 len: 1674 microversion: 2.1 time: 0.325305 Jun 29 08:09:21.421571 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 354/719] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:09:21 2022] GET /compute/v2.1/servers/d7e8f0a8-6cfe-4b0e-818a-a078672dbd87 => generated 1674 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:09:21.644872 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-d7c89052-05f5-4c7b-ae32-80acf3bcc933 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:09:21.651087 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-d7c89052-05f5-4c7b-ae32-80acf3bcc933 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] [instance: 4e4c90a0-14de-401e-80d5-fe4bf684d991] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:09:21.685080 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-d7c89052-05f5-4c7b-ae32-80acf3bcc933 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:09:21.686259 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-d7c89052-05f5-4c7b-ae32-80acf3bcc933 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:09:21.688825 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-d7c89052-05f5-4c7b-ae32-80acf3bcc933 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:09:21.690975 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-d7c89052-05f5-4c7b-ae32-80acf3bcc933 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:09:21.703942 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:09:21.901298 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-d7c89052-05f5-4c7b-ae32-80acf3bcc933 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:09:21.914693 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-d7c89052-05f5-4c7b-ae32-80acf3bcc933 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:09:21.926510 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-d7c89052-05f5-4c7b-ae32-80acf3bcc933 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:09:21.928062 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-d7c89052-05f5-4c7b-ae32-80acf3bcc933 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] 10.222.0.43 "GET /compute/v2.1/servers/4e4c90a0-14de-401e-80d5-fe4bf684d991" status: 200 len: 1739 microversion: 2.20 time: 0.300691 Jun 29 08:09:21.930097 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 366/720] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 29 08:09:21 2022] GET /compute/v2.1/servers/4e4c90a0-14de-401e-80d5-fe4bf684d991 => generated 1739 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:09:21.970140 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-1b6e1d6f-f824-4b8f-898c-43c72d92b492 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:09:21.996773 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [req-532da7d6-c67c-436a-886c-dfb13565d0a3 req-5a2308b5-3809-4e82-8a68-9590f62408c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7e8f0a8-6cfe-4b0e-818a-a078672dbd87", "name": "network-vif-deleted", "tag": "d0e3ab57-a5ac-41d7-84d7-f243539f967b"}]} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:09:21.997881 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-1b6e1d6f-f824-4b8f-898c-43c72d92b492 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] [instance: 83a86ef0-c066-44a7-b4eb-e32dce6e0069] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:09:22.031873 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-1b6e1d6f-f824-4b8f-898c-43c72d92b492 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:09:22.036655 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-532da7d6-c67c-436a-886c-dfb13565d0a3 req-5a2308b5-3809-4e82-8a68-9590f62408c2 service nova] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:09:22.038021 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-1b6e1d6f-f824-4b8f-898c-43c72d92b492 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:09:22.039079 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-532da7d6-c67c-436a-886c-dfb13565d0a3 req-5a2308b5-3809-4e82-8a68-9590f62408c2 service nova] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:09:22.040791 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-1b6e1d6f-f824-4b8f-898c-43c72d92b492 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:09:22.050131 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-1b6e1d6f-f824-4b8f-898c-43c72d92b492 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:09:22.091121 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.compute.server_external_events [req-532da7d6-c67c-436a-886c-dfb13565d0a3 req-5a2308b5-3809-4e82-8a68-9590f62408c2 service nova] Creating event network-vif-deleted:d0e3ab57-a5ac-41d7-84d7-f243539f967b for instance d7e8f0a8-6cfe-4b0e-818a-a078672dbd87 on hv-cinder-76810 Jun 29 08:09:22.105580 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [req-532da7d6-c67c-436a-886c-dfb13565d0a3 req-5a2308b5-3809-4e82-8a68-9590f62408c2 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116144 Jun 29 08:09:22.111541 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 367/721] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jun 29 08:09:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:09:22.413364 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-1b6e1d6f-f824-4b8f-898c-43c72d92b492 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de6636a0522642799e43a8f02ee602ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a20f6f9f254aae91c952ee44a4ff74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:09:22.438841 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-1b6e1d6f-f824-4b8f-898c-43c72d92b492 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] 10.222.0.43 "GET /compute/v2.1/servers/83a86ef0-c066-44a7-b4eb-e32dce6e0069" status: 200 len: 1570 microversion: 2.1 time: 0.477427 Jun 29 08:09:22.442298 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 355/722] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:09:21 2022] GET /compute/v2.1/servers/83a86ef0-c066-44a7-b4eb-e32dce6e0069 => generated 1570 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:09:22.449874 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-dc7a0333-c745-4972-bfcf-e99752301f56 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:09:22.450755 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-dc7a0333-c745-4972-bfcf-e99752301f56 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] [instance: d7e8f0a8-6cfe-4b0e-818a-a078672dbd87] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:09:22.458721 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-dc7a0333-c745-4972-bfcf-e99752301f56 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:09:22.459191 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-dc7a0333-c745-4972-bfcf-e99752301f56 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:09:22.460007 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-dc7a0333-c745-4972-bfcf-e99752301f56 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:09:22.461027 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-dc7a0333-c745-4972-bfcf-e99752301f56 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:09:22.533289 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-dc7a0333-c745-4972-bfcf-e99752301f56 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:09:22.534007 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-dc7a0333-c745-4972-bfcf-e99752301f56 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:09:22.534639 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.objects.instance [None req-dc7a0333-c745-4972-bfcf-e99752301f56 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lazy-loading 'fault' on Instance uuid d7e8f0a8-6cfe-4b0e-818a-a078672dbd87 {{(pid=117889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 29 08:09:22.613379 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-dc7a0333-c745-4972-bfcf-e99752301f56 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c70c44993ab240b1a5231df4c9d550c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e0c37d941434569b3dbd07e22125210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:09:22.624927 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-dc7a0333-c745-4972-bfcf-e99752301f56 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] 10.222.0.43 "GET /compute/v2.1/servers/d7e8f0a8-6cfe-4b0e-818a-a078672dbd87" status: 200 len: 1328 microversion: 2.1 time: 0.178289 Jun 29 08:09:22.635087 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 368/723] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:09:22 2022] GET /compute/v2.1/servers/d7e8f0a8-6cfe-4b0e-818a-a078672dbd87 => generated 1328 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:09:22.951281 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-73b8e8b0-fe58-43c4-8360-bb1733f6779b tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:09:22.953128 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-73b8e8b0-fe58-43c4-8360-bb1733f6779b tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] [instance: 4e4c90a0-14de-401e-80d5-fe4bf684d991] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:09:22.968029 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-73b8e8b0-fe58-43c4-8360-bb1733f6779b tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:09:22.968909 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-73b8e8b0-fe58-43c4-8360-bb1733f6779b tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:09:22.970379 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-73b8e8b0-fe58-43c4-8360-bb1733f6779b tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:09:22.971778 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-73b8e8b0-fe58-43c4-8360-bb1733f6779b tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:09:23.161506 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-73b8e8b0-fe58-43c4-8360-bb1733f6779b tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:09:23.173449 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-73b8e8b0-fe58-43c4-8360-bb1733f6779b tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:09:23.175161 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-73b8e8b0-fe58-43c4-8360-bb1733f6779b tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:09:23.176936 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-73b8e8b0-fe58-43c4-8360-bb1733f6779b tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] 10.222.0.43 "GET /compute/v2.1/servers/4e4c90a0-14de-401e-80d5-fe4bf684d991" status: 200 len: 1739 microversion: 2.20 time: 0.233005 Jun 29 08:09:23.177752 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 356/724] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 29 08:09:22 2022] GET /compute/v2.1/servers/4e4c90a0-14de-401e-80d5-fe4bf684d991 => generated 1739 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 29 08:09:23.465328 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-65651265-bc4e-4a76-bf85-0eecaa1f1d0b tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:09:23.466533 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-65651265-bc4e-4a76-bf85-0eecaa1f1d0b tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] [instance: 83a86ef0-c066-44a7-b4eb-e32dce6e0069] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:09:23.477905 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-65651265-bc4e-4a76-bf85-0eecaa1f1d0b tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:09:23.479208 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-65651265-bc4e-4a76-bf85-0eecaa1f1d0b tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:09:23.481155 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-65651265-bc4e-4a76-bf85-0eecaa1f1d0b tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:09:23.482425 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-65651265-bc4e-4a76-bf85-0eecaa1f1d0b tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:09:23.656828 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-ca09d05f-a7f0-4513-a52f-49c24b70f30e tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:09:23.657529 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-ca09d05f-a7f0-4513-a52f-49c24b70f30e tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] [instance: d7e8f0a8-6cfe-4b0e-818a-a078672dbd87] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:09:23.664694 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-ca09d05f-a7f0-4513-a52f-49c24b70f30e tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:09:23.665449 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-ca09d05f-a7f0-4513-a52f-49c24b70f30e tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:09:23.666703 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-ca09d05f-a7f0-4513-a52f-49c24b70f30e tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:09:23.667376 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-ca09d05f-a7f0-4513-a52f-49c24b70f30e tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:09:23.688725 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.wsgi [None req-ca09d05f-a7f0-4513-a52f-49c24b70f30e tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] HTTP exception thrown: Instance d7e8f0a8-6cfe-4b0e-818a-a078672dbd87 could not be found. Jun 29 08:09:23.690786 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-ca09d05f-a7f0-4513-a52f-49c24b70f30e tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Request method failure captured: Jun 29 08:09:23.690786 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: request: GET /compute/v2.1/servers/d7e8f0a8-6cfe-4b0e-818a-a078672dbd87 HTTP/1.1 Jun 29 08:09:23.690786 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: Accept: application/json Jun 29 08:09:23.690786 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: Accept-Encoding: identity Jun 29 08:09:23.690786 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: Connection: close Jun 29 08:09:23.690786 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: Content-Length: 0 Jun 29 08:09:23.690786 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: Content-Type: application/json Jun 29 08:09:23.690786 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: Host: 10.222.0.43 Jun 29 08:09:23.690786 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: Openstack-System-Scope: None Jun 29 08:09:23.690786 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: User-Agent: python-urllib3/1.26.9 Jun 29 08:09:23.690786 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Auth-Token: gAAAAABivAcyZeyrH2axHUIXOcPlzSz3gyuz58Vq5Ys_YNkMPTpXWZCJYExlwFCI3RcXFcV0XEjyDZvezT8IDEuTSptAu7fY1puGLXMaJYdZOKCqi6ioEaGyNbmX3l2_TOYILVhHEtKfASNvBXUCvkGa1RrAu2mrU0HWt9cDHpsWYJd2mZuJkkM Jun 29 08:09:23.690786 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Domain-Id: None Jun 29 08:09:23.690786 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Domain-Name: None Jun 29 08:09:23.690786 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Identity-Status: Confirmed Jun 29 08:09:23.690786 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Is-Admin-Project: True Jun 29 08:09:23.690786 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Project-Domain-Id: default Jun 29 08:09:23.690786 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Project-Domain-Name: Default Jun 29 08:09:23.690786 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Project-Id: 5e0c37d941434569b3dbd07e22125210 Jun 29 08:09:23.690786 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Project-Name: tempest-AttachVolumeTestJSON-2125572094 Jun 29 08:09:23.690786 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Role: member,reader Jun 29 08:09:23.690786 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Roles: member,reader Jun 29 08:09:23.692435 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5e0c37d941434569b3dbd07e22125210"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_5e0c37d941434569b3dbd07e22125210"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5e0c37d941434569b3dbd07e22125210"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/5e0c37d941434569b3dbd07e22125210"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Jun 29 08:09:23.692435 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Tenant: tempest-AttachVolumeTestJSON-2125572094 Jun 29 08:09:23.692435 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Tenant-Id: 5e0c37d941434569b3dbd07e22125210 Jun 29 08:09:23.692435 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2125572094 Jun 29 08:09:23.692435 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-User: tempest-AttachVolumeTestJSON-2125572094-project Jun 29 08:09:23.692435 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-User-Domain-Id: default Jun 29 08:09:23.692435 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-User-Domain-Name: Default Jun 29 08:09:23.692435 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-User-Id: c70c44993ab240b1a5231df4c9d550c9 Jun 29 08:09:23.692435 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-User-Name: tempest-AttachVolumeTestJSON-2125572094-project Jun 29 08:09:23.692435 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: method: > Jun 29 08:09:23.692435 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: exception: Instance d7e8f0a8-6cfe-4b0e-818a-a078672dbd87 could not be found. Jun 29 08:09:23.692435 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: action_args: {'id': 'd7e8f0a8-6cfe-4b0e-818a-a078672dbd87'} Jun 29 08:09:23.693402 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 08:09:23.693402 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:09:23.693402 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 29 08:09:23.693402 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 29 08:09:23.693402 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 29 08:09:23.693402 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 29 08:09:23.693402 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 29 08:09:23.693402 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 29 08:09:23.693402 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 29 08:09:23.693402 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 29 08:09:23.693402 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d7e8f0a8-6cfe-4b0e-818a-a078672dbd87 could not be found. Jun 29 08:09:23.693402 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 29 08:09:23.693402 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 08:09:23.693402 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 29 08:09:23.693402 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:09:23.693402 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 08:09:23.693402 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 08:09:23.693402 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 08:09:23.693402 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 08:09:23.693402 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 08:09:23.694914 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 08:09:23.694914 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 29 08:09:23.694914 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 29 08:09:23.694914 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 29 08:09:23.694914 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 29 08:09:23.694914 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 29 08:09:23.694914 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 29 08:09:23.694914 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d7e8f0a8-6cfe-4b0e-818a-a078672dbd87 could not be found. Jun 29 08:09:23.694914 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 29 08:09:23.694914 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 08:09:23.694914 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 29 08:09:23.694914 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:09:23.694914 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 08:09:23.694914 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 08:09:23.694914 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 08:09:23.694914 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 08:09:23.694914 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d7e8f0a8-6cfe-4b0e-818a-a078672dbd87 could not be found. Jun 29 08:09:23.694914 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 29 08:09:23.697309 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-ca09d05f-a7f0-4513-a52f-49c24b70f30e tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Returning 404 to user: Instance d7e8f0a8-6cfe-4b0e-818a-a078672dbd87 could not be found. {{(pid=117890) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 08:09:23.698431 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-ca09d05f-a7f0-4513-a52f-49c24b70f30e tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] 10.222.0.43 "GET /compute/v2.1/servers/d7e8f0a8-6cfe-4b0e-818a-a078672dbd87" status: 404 len: 111 microversion: 2.1 time: 0.059771 Jun 29 08:09:23.699518 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 357/725] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:09:23 2022] GET /compute/v2.1/servers/d7e8f0a8-6cfe-4b0e-818a-a078672dbd87 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 29 08:09:23.709424 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-79d48694-83ce-4bf5-93a2-818dc2b52b67 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Calling method '.version_select at 0x7f7241222d30>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:09:23.759411 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-79d48694-83ce-4bf5-93a2-818dc2b52b67 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1827614167" status: 202 len: 0 microversion: 2.1 time: 0.054106 Jun 29 08:09:23.760930 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 358/726] 10.222.0.43 () {58 vars in 1220 bytes} [Wed Jun 29 08:09:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1827614167 => generated 0 bytes in 56 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 29 08:09:23.809029 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-65651265-bc4e-4a76-bf85-0eecaa1f1d0b tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de6636a0522642799e43a8f02ee602ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a20f6f9f254aae91c952ee44a4ff74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:09:23.820959 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-65651265-bc4e-4a76-bf85-0eecaa1f1d0b tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] 10.222.0.43 "GET /compute/v2.1/servers/83a86ef0-c066-44a7-b4eb-e32dce6e0069" status: 200 len: 1570 microversion: 2.1 time: 0.363662 Jun 29 08:09:23.838532 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 369/727] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:09:23 2022] GET /compute/v2.1/servers/83a86ef0-c066-44a7-b4eb-e32dce6e0069 => generated 1570 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:09:24.224169 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-604ba468-3e22-4d31-bb36-c1436b8682cd tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:09:24.228813 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-604ba468-3e22-4d31-bb36-c1436b8682cd tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] [instance: 4e4c90a0-14de-401e-80d5-fe4bf684d991] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:09:24.240621 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG dbcounter [-] [117890] Writing DB stats nova_api:SELECT=75,nova_api:DELETE=1 {{(pid=117890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:09:24.243509 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-604ba468-3e22-4d31-bb36-c1436b8682cd tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:09:24.244507 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-604ba468-3e22-4d31-bb36-c1436b8682cd tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:09:24.245869 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-604ba468-3e22-4d31-bb36-c1436b8682cd tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:09:24.246766 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-604ba468-3e22-4d31-bb36-c1436b8682cd tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:09:24.565039 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-604ba468-3e22-4d31-bb36-c1436b8682cd tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:09:24.578738 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-604ba468-3e22-4d31-bb36-c1436b8682cd tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:09:24.580858 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-604ba468-3e22-4d31-bb36-c1436b8682cd tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:09:24.582362 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-604ba468-3e22-4d31-bb36-c1436b8682cd tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] 10.222.0.43 "GET /compute/v2.1/servers/4e4c90a0-14de-401e-80d5-fe4bf684d991" status: 200 len: 1739 microversion: 2.20 time: 0.378278 Jun 29 08:09:24.583025 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 359/728] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 29 08:09:24 2022] GET /compute/v2.1/servers/4e4c90a0-14de-401e-80d5-fe4bf684d991 => generated 1739 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:09:24.846833 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-50a92620-e1f3-45d0-a70f-0150bd50b5fd tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:09:24.848087 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-50a92620-e1f3-45d0-a70f-0150bd50b5fd tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] [instance: 83a86ef0-c066-44a7-b4eb-e32dce6e0069] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:09:24.854899 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-50a92620-e1f3-45d0-a70f-0150bd50b5fd tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:09:24.855656 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-50a92620-e1f3-45d0-a70f-0150bd50b5fd tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:09:24.856677 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-50a92620-e1f3-45d0-a70f-0150bd50b5fd tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:09:24.857322 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-50a92620-e1f3-45d0-a70f-0150bd50b5fd tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:09:25.143389 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-50a92620-e1f3-45d0-a70f-0150bd50b5fd tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de6636a0522642799e43a8f02ee602ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a20f6f9f254aae91c952ee44a4ff74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:09:25.157135 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-50a92620-e1f3-45d0-a70f-0150bd50b5fd tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] 10.222.0.43 "GET /compute/v2.1/servers/83a86ef0-c066-44a7-b4eb-e32dce6e0069" status: 200 len: 1570 microversion: 2.1 time: 0.314617 Jun 29 08:09:25.158232 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 370/729] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:09:24 2022] GET /compute/v2.1/servers/83a86ef0-c066-44a7-b4eb-e32dce6e0069 => generated 1570 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:09:25.608005 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-60f07684-c3c3-4ae1-aa90-8949d3a26157 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:09:25.609495 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-60f07684-c3c3-4ae1-aa90-8949d3a26157 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] [instance: 4e4c90a0-14de-401e-80d5-fe4bf684d991] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:09:25.621683 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-60f07684-c3c3-4ae1-aa90-8949d3a26157 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:09:25.622963 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-60f07684-c3c3-4ae1-aa90-8949d3a26157 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:09:25.625235 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-60f07684-c3c3-4ae1-aa90-8949d3a26157 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:09:25.626136 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-60f07684-c3c3-4ae1-aa90-8949d3a26157 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:09:25.864279 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-60f07684-c3c3-4ae1-aa90-8949d3a26157 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:09:25.879618 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-60f07684-c3c3-4ae1-aa90-8949d3a26157 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:09:25.886964 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-60f07684-c3c3-4ae1-aa90-8949d3a26157 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:09:25.888497 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-60f07684-c3c3-4ae1-aa90-8949d3a26157 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] 10.222.0.43 "GET /compute/v2.1/servers/4e4c90a0-14de-401e-80d5-fe4bf684d991" status: 200 len: 1739 microversion: 2.20 time: 0.287775 Jun 29 08:09:25.889590 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 360/730] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 29 08:09:25 2022] GET /compute/v2.1/servers/4e4c90a0-14de-401e-80d5-fe4bf684d991 => generated 1739 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:09:26.189403 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-3b75778c-34e7-4c01-8b1f-59bc0c116c58 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:09:26.192139 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-3b75778c-34e7-4c01-8b1f-59bc0c116c58 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] [instance: 83a86ef0-c066-44a7-b4eb-e32dce6e0069] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:09:26.204083 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:09:26.207300 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-3b75778c-34e7-4c01-8b1f-59bc0c116c58 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:09:26.208285 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-3b75778c-34e7-4c01-8b1f-59bc0c116c58 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:09:26.222763 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-3b75778c-34e7-4c01-8b1f-59bc0c116c58 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:09:26.223688 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-3b75778c-34e7-4c01-8b1f-59bc0c116c58 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:09:26.522452 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-3b75778c-34e7-4c01-8b1f-59bc0c116c58 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de6636a0522642799e43a8f02ee602ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a20f6f9f254aae91c952ee44a4ff74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:09:26.539871 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-3b75778c-34e7-4c01-8b1f-59bc0c116c58 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] 10.222.0.43 "GET /compute/v2.1/servers/83a86ef0-c066-44a7-b4eb-e32dce6e0069" status: 200 len: 1570 microversion: 2.1 time: 0.360743 Jun 29 08:09:26.557016 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 371/731] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:09:26 2022] GET /compute/v2.1/servers/83a86ef0-c066-44a7-b4eb-e32dce6e0069 => generated 1570 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:09:26.919350 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-7dbfff0e-d87c-4aef-81c2-689ce6af32a1 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:09:26.920155 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-7dbfff0e-d87c-4aef-81c2-689ce6af32a1 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] [instance: 4e4c90a0-14de-401e-80d5-fe4bf684d991] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:09:26.928477 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-7dbfff0e-d87c-4aef-81c2-689ce6af32a1 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:09:26.929037 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-7dbfff0e-d87c-4aef-81c2-689ce6af32a1 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:09:26.931290 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-7dbfff0e-d87c-4aef-81c2-689ce6af32a1 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:09:26.932047 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-7dbfff0e-d87c-4aef-81c2-689ce6af32a1 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:09:27.263040 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-7dbfff0e-d87c-4aef-81c2-689ce6af32a1 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:09:27.273971 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-7dbfff0e-d87c-4aef-81c2-689ce6af32a1 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:09:27.276085 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-7dbfff0e-d87c-4aef-81c2-689ce6af32a1 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:09:27.278934 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-7dbfff0e-d87c-4aef-81c2-689ce6af32a1 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] 10.222.0.43 "GET /compute/v2.1/servers/4e4c90a0-14de-401e-80d5-fe4bf684d991" status: 200 len: 1739 microversion: 2.20 time: 0.366462 Jun 29 08:09:27.281348 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 361/732] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 29 08:09:26 2022] GET /compute/v2.1/servers/4e4c90a0-14de-401e-80d5-fe4bf684d991 => generated 1739 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:09:27.471047 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-9e02ec99-8082-40d0-8cab-5c31c6338cda tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:09:27.471819 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-9e02ec99-8082-40d0-8cab-5c31c6338cda tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] [instance: d7e8f0a8-6cfe-4b0e-818a-a078672dbd87] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:09:27.479195 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-9e02ec99-8082-40d0-8cab-5c31c6338cda tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:09:27.479685 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-9e02ec99-8082-40d0-8cab-5c31c6338cda tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:09:27.480540 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-9e02ec99-8082-40d0-8cab-5c31c6338cda tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:09:27.480921 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-9e02ec99-8082-40d0-8cab-5c31c6338cda tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:09:27.505887 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.wsgi [None req-9e02ec99-8082-40d0-8cab-5c31c6338cda tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] HTTP exception thrown: Instance d7e8f0a8-6cfe-4b0e-818a-a078672dbd87 could not be found. Jun 29 08:09:27.507941 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-9e02ec99-8082-40d0-8cab-5c31c6338cda tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Request method failure captured: Jun 29 08:09:27.507941 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: request: DELETE /compute/v2.1/servers/d7e8f0a8-6cfe-4b0e-818a-a078672dbd87 HTTP/1.1 Jun 29 08:09:27.507941 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: Accept: application/json Jun 29 08:09:27.507941 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: Accept-Encoding: identity Jun 29 08:09:27.507941 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: Connection: close Jun 29 08:09:27.507941 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: Content-Length: 0 Jun 29 08:09:27.507941 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: Content-Type: application/json Jun 29 08:09:27.507941 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: Host: 10.222.0.43 Jun 29 08:09:27.507941 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: Openstack-System-Scope: None Jun 29 08:09:27.507941 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: User-Agent: python-urllib3/1.26.9 Jun 29 08:09:27.507941 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Auth-Token: gAAAAABivAcyZeyrH2axHUIXOcPlzSz3gyuz58Vq5Ys_YNkMPTpXWZCJYExlwFCI3RcXFcV0XEjyDZvezT8IDEuTSptAu7fY1puGLXMaJYdZOKCqi6ioEaGyNbmX3l2_TOYILVhHEtKfASNvBXUCvkGa1RrAu2mrU0HWt9cDHpsWYJd2mZuJkkM Jun 29 08:09:27.507941 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Domain-Id: None Jun 29 08:09:27.507941 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Domain-Name: None Jun 29 08:09:27.507941 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Identity-Status: Confirmed Jun 29 08:09:27.507941 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Is-Admin-Project: True Jun 29 08:09:27.507941 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Project-Domain-Id: default Jun 29 08:09:27.507941 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Project-Domain-Name: Default Jun 29 08:09:27.507941 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Project-Id: 5e0c37d941434569b3dbd07e22125210 Jun 29 08:09:27.507941 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Project-Name: tempest-AttachVolumeTestJSON-2125572094 Jun 29 08:09:27.507941 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Role: member,reader Jun 29 08:09:27.507941 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Roles: member,reader Jun 29 08:09:27.513718 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5e0c37d941434569b3dbd07e22125210"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_5e0c37d941434569b3dbd07e22125210"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5e0c37d941434569b3dbd07e22125210"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/5e0c37d941434569b3dbd07e22125210"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Jun 29 08:09:27.513718 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Tenant: tempest-AttachVolumeTestJSON-2125572094 Jun 29 08:09:27.513718 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Tenant-Id: 5e0c37d941434569b3dbd07e22125210 Jun 29 08:09:27.513718 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2125572094 Jun 29 08:09:27.513718 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-User: tempest-AttachVolumeTestJSON-2125572094-project Jun 29 08:09:27.513718 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-User-Domain-Id: default Jun 29 08:09:27.513718 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-User-Domain-Name: Default Jun 29 08:09:27.513718 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-User-Id: c70c44993ab240b1a5231df4c9d550c9 Jun 29 08:09:27.513718 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-User-Name: tempest-AttachVolumeTestJSON-2125572094-project Jun 29 08:09:27.513718 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: method: > Jun 29 08:09:27.513718 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: exception: Instance d7e8f0a8-6cfe-4b0e-818a-a078672dbd87 could not be found. Jun 29 08:09:27.513718 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: action_args: {'id': 'd7e8f0a8-6cfe-4b0e-818a-a078672dbd87'} Jun 29 08:09:27.515542 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 08:09:27.515542 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:09:27.515542 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 29 08:09:27.515542 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 29 08:09:27.515542 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 29 08:09:27.515542 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 29 08:09:27.515542 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 29 08:09:27.515542 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 29 08:09:27.515542 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 29 08:09:27.515542 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 29 08:09:27.515542 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d7e8f0a8-6cfe-4b0e-818a-a078672dbd87 could not be found. Jun 29 08:09:27.515542 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 29 08:09:27.515542 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 08:09:27.515542 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 29 08:09:27.515542 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:09:27.515542 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 08:09:27.515542 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 08:09:27.515542 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 08:09:27.515542 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 08:09:27.515542 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 08:09:27.517425 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 08:09:27.517425 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 29 08:09:27.517425 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 29 08:09:27.517425 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 29 08:09:27.517425 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 29 08:09:27.517425 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 29 08:09:27.517425 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 29 08:09:27.517425 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 29 08:09:27.517425 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 29 08:09:27.517425 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d7e8f0a8-6cfe-4b0e-818a-a078672dbd87 could not be found. Jun 29 08:09:27.517425 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 29 08:09:27.517425 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 08:09:27.517425 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 29 08:09:27.517425 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:09:27.517425 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 08:09:27.517425 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 08:09:27.517425 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 08:09:27.517425 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 08:09:27.517425 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d7e8f0a8-6cfe-4b0e-818a-a078672dbd87 could not be found. Jun 29 08:09:27.517425 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 29 08:09:27.518864 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-9e02ec99-8082-40d0-8cab-5c31c6338cda tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Returning 404 to user: Instance d7e8f0a8-6cfe-4b0e-818a-a078672dbd87 could not be found. {{(pid=117889) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 08:09:27.518864 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-9e02ec99-8082-40d0-8cab-5c31c6338cda tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] 10.222.0.43 "DELETE /compute/v2.1/servers/d7e8f0a8-6cfe-4b0e-818a-a078672dbd87" status: 404 len: 111 microversion: 2.1 time: 0.043922 Jun 29 08:09:27.518864 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 372/733] 10.222.0.43 () {58 vars in 1238 bytes} [Wed Jun 29 08:09:27 2022] DELETE /compute/v2.1/servers/d7e8f0a8-6cfe-4b0e-818a-a078672dbd87 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 29 08:09:27.521667 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-dbc98009-3225-41c9-9c12-4e90e55da401 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:09:27.523296 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-dbc98009-3225-41c9-9c12-4e90e55da401 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] [instance: d7e8f0a8-6cfe-4b0e-818a-a078672dbd87] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:09:27.531622 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-dbc98009-3225-41c9-9c12-4e90e55da401 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:09:27.532214 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-dbc98009-3225-41c9-9c12-4e90e55da401 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:09:27.533083 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-dbc98009-3225-41c9-9c12-4e90e55da401 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:09:27.533653 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-dbc98009-3225-41c9-9c12-4e90e55da401 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:09:27.549040 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.wsgi [None req-dbc98009-3225-41c9-9c12-4e90e55da401 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] HTTP exception thrown: Instance d7e8f0a8-6cfe-4b0e-818a-a078672dbd87 could not be found. Jun 29 08:09:27.551760 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-dbc98009-3225-41c9-9c12-4e90e55da401 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Request method failure captured: Jun 29 08:09:27.551760 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: request: GET /compute/v2.1/servers/d7e8f0a8-6cfe-4b0e-818a-a078672dbd87 HTTP/1.1 Jun 29 08:09:27.551760 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: Accept: application/json Jun 29 08:09:27.551760 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: Accept-Encoding: identity Jun 29 08:09:27.551760 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: Connection: close Jun 29 08:09:27.551760 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: Content-Length: 0 Jun 29 08:09:27.551760 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: Content-Type: application/json Jun 29 08:09:27.551760 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: Host: 10.222.0.43 Jun 29 08:09:27.551760 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: Openstack-System-Scope: None Jun 29 08:09:27.551760 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: User-Agent: python-urllib3/1.26.9 Jun 29 08:09:27.551760 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Auth-Token: gAAAAABivAcyZeyrH2axHUIXOcPlzSz3gyuz58Vq5Ys_YNkMPTpXWZCJYExlwFCI3RcXFcV0XEjyDZvezT8IDEuTSptAu7fY1puGLXMaJYdZOKCqi6ioEaGyNbmX3l2_TOYILVhHEtKfASNvBXUCvkGa1RrAu2mrU0HWt9cDHpsWYJd2mZuJkkM Jun 29 08:09:27.551760 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Domain-Id: None Jun 29 08:09:27.551760 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Domain-Name: None Jun 29 08:09:27.551760 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Identity-Status: Confirmed Jun 29 08:09:27.551760 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Is-Admin-Project: True Jun 29 08:09:27.551760 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Project-Domain-Id: default Jun 29 08:09:27.551760 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Project-Domain-Name: Default Jun 29 08:09:27.551760 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Project-Id: 5e0c37d941434569b3dbd07e22125210 Jun 29 08:09:27.551760 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Project-Name: tempest-AttachVolumeTestJSON-2125572094 Jun 29 08:09:27.551760 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Role: member,reader Jun 29 08:09:27.551760 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Roles: member,reader Jun 29 08:09:27.553300 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5e0c37d941434569b3dbd07e22125210"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_5e0c37d941434569b3dbd07e22125210"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5e0c37d941434569b3dbd07e22125210"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/5e0c37d941434569b3dbd07e22125210"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Jun 29 08:09:27.553300 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Tenant: tempest-AttachVolumeTestJSON-2125572094 Jun 29 08:09:27.553300 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Tenant-Id: 5e0c37d941434569b3dbd07e22125210 Jun 29 08:09:27.553300 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2125572094 Jun 29 08:09:27.553300 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-User: tempest-AttachVolumeTestJSON-2125572094-project Jun 29 08:09:27.553300 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-User-Domain-Id: default Jun 29 08:09:27.553300 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-User-Domain-Name: Default Jun 29 08:09:27.553300 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-User-Id: c70c44993ab240b1a5231df4c9d550c9 Jun 29 08:09:27.553300 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-User-Name: tempest-AttachVolumeTestJSON-2125572094-project Jun 29 08:09:27.553300 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: method: > Jun 29 08:09:27.553300 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: exception: Instance d7e8f0a8-6cfe-4b0e-818a-a078672dbd87 could not be found. Jun 29 08:09:27.553300 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: action_args: {'id': 'd7e8f0a8-6cfe-4b0e-818a-a078672dbd87'} Jun 29 08:09:27.554156 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 08:09:27.554156 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:09:27.554156 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 29 08:09:27.554156 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 29 08:09:27.554156 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 29 08:09:27.554156 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 29 08:09:27.554156 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 29 08:09:27.554156 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 29 08:09:27.554156 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 29 08:09:27.554156 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 29 08:09:27.554156 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d7e8f0a8-6cfe-4b0e-818a-a078672dbd87 could not be found. Jun 29 08:09:27.554156 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 29 08:09:27.554156 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 08:09:27.554156 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 29 08:09:27.554156 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:09:27.554156 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 08:09:27.554156 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 08:09:27.554156 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 08:09:27.554156 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 08:09:27.554156 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 08:09:27.558558 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 08:09:27.558558 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 29 08:09:27.558558 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 29 08:09:27.558558 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 29 08:09:27.558558 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 29 08:09:27.558558 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 29 08:09:27.558558 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 29 08:09:27.558558 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d7e8f0a8-6cfe-4b0e-818a-a078672dbd87 could not be found. Jun 29 08:09:27.558558 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 29 08:09:27.558558 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 08:09:27.558558 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 29 08:09:27.558558 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:09:27.558558 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 08:09:27.558558 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 08:09:27.558558 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 08:09:27.558558 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 08:09:27.558558 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d7e8f0a8-6cfe-4b0e-818a-a078672dbd87 could not be found. Jun 29 08:09:27.558558 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 29 08:09:27.560786 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-dbc98009-3225-41c9-9c12-4e90e55da401 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Returning 404 to user: Instance d7e8f0a8-6cfe-4b0e-818a-a078672dbd87 could not be found. {{(pid=117890) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 08:09:27.560786 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-dbc98009-3225-41c9-9c12-4e90e55da401 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] 10.222.0.43 "GET /compute/v2.1/servers/d7e8f0a8-6cfe-4b0e-818a-a078672dbd87" status: 404 len: 111 microversion: 2.1 time: 0.036664 Jun 29 08:09:27.560786 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 362/734] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:09:27 2022] GET /compute/v2.1/servers/d7e8f0a8-6cfe-4b0e-818a-a078672dbd87 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 29 08:09:27.570392 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-047f67d3-53cb-43a4-9408-a42513c5a12b tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:09:27.571146 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-047f67d3-53cb-43a4-9408-a42513c5a12b tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] [instance: 83a86ef0-c066-44a7-b4eb-e32dce6e0069] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:09:27.581651 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-047f67d3-53cb-43a4-9408-a42513c5a12b tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:09:27.582322 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-047f67d3-53cb-43a4-9408-a42513c5a12b tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:09:27.583584 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-047f67d3-53cb-43a4-9408-a42513c5a12b tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:09:27.584180 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-047f67d3-53cb-43a4-9408-a42513c5a12b tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:09:27.762786 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-047f67d3-53cb-43a4-9408-a42513c5a12b tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de6636a0522642799e43a8f02ee602ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a20f6f9f254aae91c952ee44a4ff74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:09:27.771336 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-047f67d3-53cb-43a4-9408-a42513c5a12b tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] 10.222.0.43 "GET /compute/v2.1/servers/83a86ef0-c066-44a7-b4eb-e32dce6e0069" status: 200 len: 1570 microversion: 2.1 time: 0.206838 Jun 29 08:09:27.771924 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 373/735] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:09:27 2022] GET /compute/v2.1/servers/83a86ef0-c066-44a7-b4eb-e32dce6e0069 => generated 1570 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:09:28.299344 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-39b3b508-57f3-4b9a-b736-c9f7bbff2e2d tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:09:28.300093 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-39b3b508-57f3-4b9a-b736-c9f7bbff2e2d tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] [instance: 4e4c90a0-14de-401e-80d5-fe4bf684d991] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:09:28.309397 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-39b3b508-57f3-4b9a-b736-c9f7bbff2e2d tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:09:28.309844 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-39b3b508-57f3-4b9a-b736-c9f7bbff2e2d tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:09:28.310664 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-39b3b508-57f3-4b9a-b736-c9f7bbff2e2d tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:09:28.311157 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-39b3b508-57f3-4b9a-b736-c9f7bbff2e2d tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:09:28.484003 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-39b3b508-57f3-4b9a-b736-c9f7bbff2e2d tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:09:28.493968 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-39b3b508-57f3-4b9a-b736-c9f7bbff2e2d tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:09:28.495532 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-39b3b508-57f3-4b9a-b736-c9f7bbff2e2d tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:09:28.496800 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-39b3b508-57f3-4b9a-b736-c9f7bbff2e2d tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] 10.222.0.43 "GET /compute/v2.1/servers/4e4c90a0-14de-401e-80d5-fe4bf684d991" status: 200 len: 1739 microversion: 2.20 time: 0.202119 Jun 29 08:09:28.497430 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 363/736] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 29 08:09:28 2022] GET /compute/v2.1/servers/4e4c90a0-14de-401e-80d5-fe4bf684d991 => generated 1739 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 29 08:09:28.727355 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-1da31863-fee7-4303-bfe6-847eba51abb9 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:09:28.727874 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-1da31863-fee7-4303-bfe6-847eba51abb9 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] [instance: d5d97f9b-3f4a-4a5e-89e8-98d55412fe71] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:09:28.734500 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-1da31863-fee7-4303-bfe6-847eba51abb9 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:09:28.734956 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-1da31863-fee7-4303-bfe6-847eba51abb9 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:09:28.735739 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-1da31863-fee7-4303-bfe6-847eba51abb9 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:09:28.736184 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-1da31863-fee7-4303-bfe6-847eba51abb9 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:09:28.750999 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.wsgi [None req-1da31863-fee7-4303-bfe6-847eba51abb9 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] HTTP exception thrown: Instance d5d97f9b-3f4a-4a5e-89e8-98d55412fe71 could not be found. Jun 29 08:09:28.752589 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-1da31863-fee7-4303-bfe6-847eba51abb9 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Request method failure captured: Jun 29 08:09:28.752589 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: request: DELETE /compute/v2.1/servers/d5d97f9b-3f4a-4a5e-89e8-98d55412fe71 HTTP/1.1 Jun 29 08:09:28.752589 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: Accept: application/json Jun 29 08:09:28.752589 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: Accept-Encoding: identity Jun 29 08:09:28.752589 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: Connection: close Jun 29 08:09:28.752589 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: Content-Length: 0 Jun 29 08:09:28.752589 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: Content-Type: application/json Jun 29 08:09:28.752589 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: Host: 10.222.0.43 Jun 29 08:09:28.752589 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: Openstack-System-Scope: None Jun 29 08:09:28.752589 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: User-Agent: python-urllib3/1.26.9 Jun 29 08:09:28.752589 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Auth-Token: gAAAAABivAcyZeyrH2axHUIXOcPlzSz3gyuz58Vq5Ys_YNkMPTpXWZCJYExlwFCI3RcXFcV0XEjyDZvezT8IDEuTSptAu7fY1puGLXMaJYdZOKCqi6ioEaGyNbmX3l2_TOYILVhHEtKfASNvBXUCvkGa1RrAu2mrU0HWt9cDHpsWYJd2mZuJkkM Jun 29 08:09:28.752589 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Domain-Id: None Jun 29 08:09:28.752589 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Domain-Name: None Jun 29 08:09:28.752589 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Identity-Status: Confirmed Jun 29 08:09:28.752589 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Is-Admin-Project: True Jun 29 08:09:28.752589 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Project-Domain-Id: default Jun 29 08:09:28.752589 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Project-Domain-Name: Default Jun 29 08:09:28.752589 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Project-Id: 5e0c37d941434569b3dbd07e22125210 Jun 29 08:09:28.752589 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Project-Name: tempest-AttachVolumeTestJSON-2125572094 Jun 29 08:09:28.752589 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Role: member,reader Jun 29 08:09:28.752589 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Roles: member,reader Jun 29 08:09:28.754873 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5e0c37d941434569b3dbd07e22125210"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_5e0c37d941434569b3dbd07e22125210"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5e0c37d941434569b3dbd07e22125210"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/5e0c37d941434569b3dbd07e22125210"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Jun 29 08:09:28.754873 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Tenant: tempest-AttachVolumeTestJSON-2125572094 Jun 29 08:09:28.754873 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Tenant-Id: 5e0c37d941434569b3dbd07e22125210 Jun 29 08:09:28.754873 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2125572094 Jun 29 08:09:28.754873 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-User: tempest-AttachVolumeTestJSON-2125572094-project Jun 29 08:09:28.754873 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-User-Domain-Id: default Jun 29 08:09:28.754873 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-User-Domain-Name: Default Jun 29 08:09:28.754873 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-User-Id: c70c44993ab240b1a5231df4c9d550c9 Jun 29 08:09:28.754873 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-User-Name: tempest-AttachVolumeTestJSON-2125572094-project Jun 29 08:09:28.754873 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: method: > Jun 29 08:09:28.754873 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: exception: Instance d5d97f9b-3f4a-4a5e-89e8-98d55412fe71 could not be found. Jun 29 08:09:28.754873 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: action_args: {'id': 'd5d97f9b-3f4a-4a5e-89e8-98d55412fe71'} Jun 29 08:09:28.756152 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 08:09:28.756152 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:09:28.756152 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 29 08:09:28.756152 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 29 08:09:28.756152 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 29 08:09:28.756152 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 29 08:09:28.756152 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 29 08:09:28.756152 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 29 08:09:28.756152 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 29 08:09:28.756152 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 29 08:09:28.756152 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d5d97f9b-3f4a-4a5e-89e8-98d55412fe71 could not be found. Jun 29 08:09:28.756152 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 29 08:09:28.756152 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 08:09:28.756152 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 29 08:09:28.756152 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:09:28.756152 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 08:09:28.756152 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 08:09:28.756152 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 08:09:28.756152 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 08:09:28.756152 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 08:09:28.758607 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 08:09:28.758607 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 29 08:09:28.758607 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 29 08:09:28.758607 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 29 08:09:28.758607 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 29 08:09:28.758607 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 29 08:09:28.758607 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 29 08:09:28.758607 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 29 08:09:28.758607 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 29 08:09:28.758607 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d5d97f9b-3f4a-4a5e-89e8-98d55412fe71 could not be found. Jun 29 08:09:28.758607 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 29 08:09:28.758607 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 08:09:28.758607 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 29 08:09:28.758607 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:09:28.758607 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 08:09:28.758607 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 08:09:28.758607 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 08:09:28.758607 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 08:09:28.758607 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d5d97f9b-3f4a-4a5e-89e8-98d55412fe71 could not be found. Jun 29 08:09:28.758607 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 29 08:09:28.761028 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-1da31863-fee7-4303-bfe6-847eba51abb9 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Returning 404 to user: Instance d5d97f9b-3f4a-4a5e-89e8-98d55412fe71 could not be found. {{(pid=117889) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 08:09:28.761028 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-1da31863-fee7-4303-bfe6-847eba51abb9 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] 10.222.0.43 "DELETE /compute/v2.1/servers/d5d97f9b-3f4a-4a5e-89e8-98d55412fe71" status: 404 len: 111 microversion: 2.1 time: 0.030627 Jun 29 08:09:28.761028 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 374/737] 10.222.0.43 () {58 vars in 1238 bytes} [Wed Jun 29 08:09:28 2022] DELETE /compute/v2.1/servers/d5d97f9b-3f4a-4a5e-89e8-98d55412fe71 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 29 08:09:28.763769 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-015da4d2-f4fd-4f95-b950-9693530b9368 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:09:28.765083 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-015da4d2-f4fd-4f95-b950-9693530b9368 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] [instance: d5d97f9b-3f4a-4a5e-89e8-98d55412fe71] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:09:28.771398 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-015da4d2-f4fd-4f95-b950-9693530b9368 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:09:28.771852 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-015da4d2-f4fd-4f95-b950-9693530b9368 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:09:28.772628 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-015da4d2-f4fd-4f95-b950-9693530b9368 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:09:28.773091 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-015da4d2-f4fd-4f95-b950-9693530b9368 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:09:28.787531 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.wsgi [None req-015da4d2-f4fd-4f95-b950-9693530b9368 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] HTTP exception thrown: Instance d5d97f9b-3f4a-4a5e-89e8-98d55412fe71 could not be found. Jun 29 08:09:28.789124 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-015da4d2-f4fd-4f95-b950-9693530b9368 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Request method failure captured: Jun 29 08:09:28.789124 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: request: GET /compute/v2.1/servers/d5d97f9b-3f4a-4a5e-89e8-98d55412fe71 HTTP/1.1 Jun 29 08:09:28.789124 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: Accept: application/json Jun 29 08:09:28.789124 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: Accept-Encoding: identity Jun 29 08:09:28.789124 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: Connection: close Jun 29 08:09:28.789124 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: Content-Length: 0 Jun 29 08:09:28.789124 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: Content-Type: application/json Jun 29 08:09:28.789124 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: Host: 10.222.0.43 Jun 29 08:09:28.789124 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: Openstack-System-Scope: None Jun 29 08:09:28.789124 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: User-Agent: python-urllib3/1.26.9 Jun 29 08:09:28.789124 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Auth-Token: gAAAAABivAcyZeyrH2axHUIXOcPlzSz3gyuz58Vq5Ys_YNkMPTpXWZCJYExlwFCI3RcXFcV0XEjyDZvezT8IDEuTSptAu7fY1puGLXMaJYdZOKCqi6ioEaGyNbmX3l2_TOYILVhHEtKfASNvBXUCvkGa1RrAu2mrU0HWt9cDHpsWYJd2mZuJkkM Jun 29 08:09:28.789124 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Domain-Id: None Jun 29 08:09:28.789124 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Domain-Name: None Jun 29 08:09:28.789124 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Identity-Status: Confirmed Jun 29 08:09:28.789124 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Is-Admin-Project: True Jun 29 08:09:28.789124 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Project-Domain-Id: default Jun 29 08:09:28.789124 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Project-Domain-Name: Default Jun 29 08:09:28.789124 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Project-Id: 5e0c37d941434569b3dbd07e22125210 Jun 29 08:09:28.789124 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Project-Name: tempest-AttachVolumeTestJSON-2125572094 Jun 29 08:09:28.789124 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Role: member,reader Jun 29 08:09:28.789124 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Roles: member,reader Jun 29 08:09:28.790751 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5e0c37d941434569b3dbd07e22125210"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_5e0c37d941434569b3dbd07e22125210"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/5e0c37d941434569b3dbd07e22125210"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/5e0c37d941434569b3dbd07e22125210"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Jun 29 08:09:28.790751 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Tenant: tempest-AttachVolumeTestJSON-2125572094 Jun 29 08:09:28.790751 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Tenant-Id: 5e0c37d941434569b3dbd07e22125210 Jun 29 08:09:28.790751 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2125572094 Jun 29 08:09:28.790751 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-User: tempest-AttachVolumeTestJSON-2125572094-project Jun 29 08:09:28.790751 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-User-Domain-Id: default Jun 29 08:09:28.790751 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-User-Domain-Name: Default Jun 29 08:09:28.790751 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-User-Id: c70c44993ab240b1a5231df4c9d550c9 Jun 29 08:09:28.790751 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-User-Name: tempest-AttachVolumeTestJSON-2125572094-project Jun 29 08:09:28.790751 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: method: > Jun 29 08:09:28.790751 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: exception: Instance d5d97f9b-3f4a-4a5e-89e8-98d55412fe71 could not be found. Jun 29 08:09:28.790751 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: action_args: {'id': 'd5d97f9b-3f4a-4a5e-89e8-98d55412fe71'} Jun 29 08:09:28.791663 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 08:09:28.791663 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:09:28.791663 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 29 08:09:28.791663 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 29 08:09:28.791663 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 29 08:09:28.791663 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 29 08:09:28.791663 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 29 08:09:28.791663 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 29 08:09:28.791663 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 29 08:09:28.791663 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 29 08:09:28.791663 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d5d97f9b-3f4a-4a5e-89e8-98d55412fe71 could not be found. Jun 29 08:09:28.791663 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 29 08:09:28.791663 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 08:09:28.791663 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 29 08:09:28.791663 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:09:28.791663 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 08:09:28.791663 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 08:09:28.791663 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 08:09:28.791663 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 08:09:28.791663 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 08:09:28.793158 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 08:09:28.793158 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 29 08:09:28.793158 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 29 08:09:28.793158 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 29 08:09:28.793158 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 29 08:09:28.793158 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 29 08:09:28.793158 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 29 08:09:28.793158 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d5d97f9b-3f4a-4a5e-89e8-98d55412fe71 could not be found. Jun 29 08:09:28.793158 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 29 08:09:28.793158 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 08:09:28.793158 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 29 08:09:28.793158 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:09:28.793158 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 08:09:28.793158 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 08:09:28.793158 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 08:09:28.793158 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 08:09:28.793158 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d5d97f9b-3f4a-4a5e-89e8-98d55412fe71 could not be found. Jun 29 08:09:28.793158 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 29 08:09:28.794474 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-015da4d2-f4fd-4f95-b950-9693530b9368 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] Returning 404 to user: Instance d5d97f9b-3f4a-4a5e-89e8-98d55412fe71 could not be found. {{(pid=117890) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 08:09:28.794564 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-172a9286-9d4d-463d-946b-10154ebc6364 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:09:28.794679 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-015da4d2-f4fd-4f95-b950-9693530b9368 tempest-AttachVolumeTestJSON-2125572094 tempest-AttachVolumeTestJSON-2125572094-project] 10.222.0.43 "GET /compute/v2.1/servers/d5d97f9b-3f4a-4a5e-89e8-98d55412fe71" status: 404 len: 111 microversion: 2.1 time: 0.031116 Jun 29 08:09:28.794771 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-172a9286-9d4d-463d-946b-10154ebc6364 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] [instance: 83a86ef0-c066-44a7-b4eb-e32dce6e0069] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:09:28.794867 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 364/738] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:09:28 2022] GET /compute/v2.1/servers/d5d97f9b-3f4a-4a5e-89e8-98d55412fe71 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 29 08:09:28.803238 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-172a9286-9d4d-463d-946b-10154ebc6364 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:09:28.803687 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-172a9286-9d4d-463d-946b-10154ebc6364 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:09:28.804483 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-172a9286-9d4d-463d-946b-10154ebc6364 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:09:28.804922 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-172a9286-9d4d-463d-946b-10154ebc6364 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:09:29.292374 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-172a9286-9d4d-463d-946b-10154ebc6364 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de6636a0522642799e43a8f02ee602ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a20f6f9f254aae91c952ee44a4ff74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:09:29.313704 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-172a9286-9d4d-463d-946b-10154ebc6364 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] 10.222.0.43 "GET /compute/v2.1/servers/83a86ef0-c066-44a7-b4eb-e32dce6e0069" status: 200 len: 1570 microversion: 2.1 time: 0.527993 Jun 29 08:09:29.315545 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 375/739] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:09:28 2022] GET /compute/v2.1/servers/83a86ef0-c066-44a7-b4eb-e32dce6e0069 => generated 1570 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:09:29.522730 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-264d8dc4-85bb-4d5d-9e2d-a8c8fcff858b tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:09:29.523880 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-264d8dc4-85bb-4d5d-9e2d-a8c8fcff858b tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] [instance: 4e4c90a0-14de-401e-80d5-fe4bf684d991] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:09:29.546457 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-264d8dc4-85bb-4d5d-9e2d-a8c8fcff858b tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:09:29.547508 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-264d8dc4-85bb-4d5d-9e2d-a8c8fcff858b tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:09:29.548940 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-264d8dc4-85bb-4d5d-9e2d-a8c8fcff858b tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:09:29.553700 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-264d8dc4-85bb-4d5d-9e2d-a8c8fcff858b tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:09:29.881713 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-264d8dc4-85bb-4d5d-9e2d-a8c8fcff858b tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:09:29.899562 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-264d8dc4-85bb-4d5d-9e2d-a8c8fcff858b tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:09:29.908741 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-264d8dc4-85bb-4d5d-9e2d-a8c8fcff858b tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:09:29.919926 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-264d8dc4-85bb-4d5d-9e2d-a8c8fcff858b tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] 10.222.0.43 "GET /compute/v2.1/servers/4e4c90a0-14de-401e-80d5-fe4bf684d991" status: 200 len: 1721 microversion: 2.20 time: 0.407155 Jun 29 08:09:29.922104 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 365/740] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 29 08:09:29 2022] GET /compute/v2.1/servers/4e4c90a0-14de-401e-80d5-fe4bf684d991 => generated 1721 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:09:30.339799 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-a59eb877-bbce-467b-8e37-cdc8d9845bfd tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:09:30.340461 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-a59eb877-bbce-467b-8e37-cdc8d9845bfd tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] [instance: 83a86ef0-c066-44a7-b4eb-e32dce6e0069] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:09:30.348015 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-a59eb877-bbce-467b-8e37-cdc8d9845bfd tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:09:30.348466 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-a59eb877-bbce-467b-8e37-cdc8d9845bfd tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:09:30.349272 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-a59eb877-bbce-467b-8e37-cdc8d9845bfd tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:09:30.349707 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-a59eb877-bbce-467b-8e37-cdc8d9845bfd tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:09:30.630585 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-a59eb877-bbce-467b-8e37-cdc8d9845bfd tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de6636a0522642799e43a8f02ee602ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a20f6f9f254aae91c952ee44a4ff74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:09:30.638545 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-a59eb877-bbce-467b-8e37-cdc8d9845bfd tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] 10.222.0.43 "GET /compute/v2.1/servers/83a86ef0-c066-44a7-b4eb-e32dce6e0069" status: 200 len: 1571 microversion: 2.1 time: 0.302603 Jun 29 08:09:30.639119 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 376/741] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:09:30 2022] GET /compute/v2.1/servers/83a86ef0-c066-44a7-b4eb-e32dce6e0069 => generated 1571 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:09:30.658475 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-9ff88d46-e437-4412-a1c1-88b9d92aa763 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:09:30.659191 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-9ff88d46-e437-4412-a1c1-88b9d92aa763 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] [instance: 83a86ef0-c066-44a7-b4eb-e32dce6e0069] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:09:30.669607 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-9ff88d46-e437-4412-a1c1-88b9d92aa763 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:09:30.670550 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-9ff88d46-e437-4412-a1c1-88b9d92aa763 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:09:30.671980 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-9ff88d46-e437-4412-a1c1-88b9d92aa763 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:09:30.672753 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-9ff88d46-e437-4412-a1c1-88b9d92aa763 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:09:30.698746 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG dbcounter [-] [117890] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:09:30.799498 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-9ff88d46-e437-4412-a1c1-88b9d92aa763 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] 10.222.0.43 "POST /compute/v2.1/servers/83a86ef0-c066-44a7-b4eb-e32dce6e0069/action" status: 202 len: 0 microversion: 2.1 time: 0.146873 Jun 29 08:09:30.800120 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 366/742] 10.222.0.43 () {60 vars in 1277 bytes} [Wed Jun 29 08:09:30 2022] POST /compute/v2.1/servers/83a86ef0-c066-44a7-b4eb-e32dce6e0069/action => generated 0 bytes in 148 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 29 08:09:30.808860 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-500a542e-7ca7-4d3a-8aeb-02f82d6a1f90 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:09:30.809519 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-500a542e-7ca7-4d3a-8aeb-02f82d6a1f90 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] [instance: 83a86ef0-c066-44a7-b4eb-e32dce6e0069] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:09:30.816531 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-500a542e-7ca7-4d3a-8aeb-02f82d6a1f90 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:09:30.817020 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-500a542e-7ca7-4d3a-8aeb-02f82d6a1f90 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:09:30.817825 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-500a542e-7ca7-4d3a-8aeb-02f82d6a1f90 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:09:30.818317 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-500a542e-7ca7-4d3a-8aeb-02f82d6a1f90 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:09:30.942004 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-8047cc0f-cc37-4bb5-a65e-8023aee0a481 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:09:30.942614 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-8047cc0f-cc37-4bb5-a65e-8023aee0a481 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] [instance: 4e4c90a0-14de-401e-80d5-fe4bf684d991] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:09:30.949714 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-8047cc0f-cc37-4bb5-a65e-8023aee0a481 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:09:30.950158 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-8047cc0f-cc37-4bb5-a65e-8023aee0a481 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:09:30.950953 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-8047cc0f-cc37-4bb5-a65e-8023aee0a481 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:09:30.951391 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-8047cc0f-cc37-4bb5-a65e-8023aee0a481 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:09:31.131850 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-8047cc0f-cc37-4bb5-a65e-8023aee0a481 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:09:31.142106 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-8047cc0f-cc37-4bb5-a65e-8023aee0a481 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:09:31.143833 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-8047cc0f-cc37-4bb5-a65e-8023aee0a481 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:09:31.146418 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-8047cc0f-cc37-4bb5-a65e-8023aee0a481 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] 10.222.0.43 "GET /compute/v2.1/servers/4e4c90a0-14de-401e-80d5-fe4bf684d991" status: 200 len: 1721 microversion: 2.20 time: 0.208328 Jun 29 08:09:31.148241 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-500a542e-7ca7-4d3a-8aeb-02f82d6a1f90 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de6636a0522642799e43a8f02ee602ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a20f6f9f254aae91c952ee44a4ff74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:09:31.156890 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-500a542e-7ca7-4d3a-8aeb-02f82d6a1f90 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] 10.222.0.43 "GET /compute/v2.1/servers/83a86ef0-c066-44a7-b4eb-e32dce6e0069" status: 200 len: 1579 microversion: 2.1 time: 0.352141 Jun 29 08:09:31.157886 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 367/743] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 29 08:09:30 2022] GET /compute/v2.1/servers/4e4c90a0-14de-401e-80d5-fe4bf684d991 => generated 1721 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:09:31.158646 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 377/744] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:09:30 2022] GET /compute/v2.1/servers/83a86ef0-c066-44a7-b4eb-e32dce6e0069 => generated 1579 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 08:09:32.170379 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-814ef9a6-c736-4df1-ba5a-c704fd900550 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:09:32.174789 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-814ef9a6-c736-4df1-ba5a-c704fd900550 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] [instance: 4e4c90a0-14de-401e-80d5-fe4bf684d991] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:09:32.176969 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-53a29e66-5ee3-4342-8ffc-f6032931fd09 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:09:32.177773 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-53a29e66-5ee3-4342-8ffc-f6032931fd09 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] [instance: 83a86ef0-c066-44a7-b4eb-e32dce6e0069] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:09:32.192467 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-814ef9a6-c736-4df1-ba5a-c704fd900550 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:09:32.193559 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-814ef9a6-c736-4df1-ba5a-c704fd900550 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:09:32.195049 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-814ef9a6-c736-4df1-ba5a-c704fd900550 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:09:32.195871 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-814ef9a6-c736-4df1-ba5a-c704fd900550 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:09:32.196846 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-53a29e66-5ee3-4342-8ffc-f6032931fd09 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:09:32.198226 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-53a29e66-5ee3-4342-8ffc-f6032931fd09 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:09:32.199879 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-53a29e66-5ee3-4342-8ffc-f6032931fd09 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:09:32.200856 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-53a29e66-5ee3-4342-8ffc-f6032931fd09 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:09:32.396010 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-53a29e66-5ee3-4342-8ffc-f6032931fd09 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de6636a0522642799e43a8f02ee602ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a20f6f9f254aae91c952ee44a4ff74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:09:32.411323 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-53a29e66-5ee3-4342-8ffc-f6032931fd09 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] 10.222.0.43 "GET /compute/v2.1/servers/83a86ef0-c066-44a7-b4eb-e32dce6e0069" status: 200 len: 1521 microversion: 2.1 time: 0.238501 Jun 29 08:09:32.432905 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 378/745] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:09:32 2022] GET /compute/v2.1/servers/83a86ef0-c066-44a7-b4eb-e32dce6e0069 => generated 1521 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:09:32.660458 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-814ef9a6-c736-4df1-ba5a-c704fd900550 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:09:32.669548 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-814ef9a6-c736-4df1-ba5a-c704fd900550 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:09:32.672105 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-814ef9a6-c736-4df1-ba5a-c704fd900550 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:09:32.673497 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-814ef9a6-c736-4df1-ba5a-c704fd900550 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] 10.222.0.43 "GET /compute/v2.1/servers/4e4c90a0-14de-401e-80d5-fe4bf684d991" status: 200 len: 1724 microversion: 2.20 time: 0.510355 Jun 29 08:09:32.674214 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 368/746] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 29 08:09:32 2022] GET /compute/v2.1/servers/4e4c90a0-14de-401e-80d5-fe4bf684d991 => generated 1724 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:09:32.697982 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-7b9e8eca-ffec-4faa-b928-cdcd093f888a tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cbdc277a-7942-42a0-990d-a940eab0c8f5"}} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:09:32.699826 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-7b9e8eca-ffec-4faa-b928-cdcd093f888a tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] [instance: 4e4c90a0-14de-401e-80d5-fe4bf684d991] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:09:32.708701 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-7b9e8eca-ffec-4faa-b928-cdcd093f888a tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:09:32.709237 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-7b9e8eca-ffec-4faa-b928-cdcd093f888a tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:09:32.710125 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-7b9e8eca-ffec-4faa-b928-cdcd093f888a tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:09:32.711070 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-7b9e8eca-ffec-4faa-b928-cdcd093f888a tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:09:33.284612 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [req-f401cb25-665b-4d39-a79c-116521534414 req-37e00069-2eb5-4f08-abec-bafb58837b10 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e4c90a0-14de-401e-80d5-fe4bf684d991", "name": "network-vif-unplugged", "status": "completed", "tag": "747dea80-5c60-451c-bba1-3aabe38a1272"}]} {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:09:33.303224 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [req-f401cb25-665b-4d39-a79c-116521534414 req-37e00069-2eb5-4f08-abec-bafb58837b10 service nova] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:09:33.303859 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [req-f401cb25-665b-4d39-a79c-116521534414 req-37e00069-2eb5-4f08-abec-bafb58837b10 service nova] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:09:33.309121 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-7b9e8eca-ffec-4faa-b928-cdcd093f888a tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] 10.222.0.43 "POST /compute/v2.1/servers/4e4c90a0-14de-401e-80d5-fe4bf684d991/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.618534 Jun 29 08:09:33.312089 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 379/747] 10.222.0.43 () {62 vars in 1363 bytes} [Wed Jun 29 08:09:32 2022] POST /compute/v2.1/servers/4e4c90a0-14de-401e-80d5-fe4bf684d991/os-volume_attachments => generated 188 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 29 08:09:33.324205 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.compute.server_external_events [req-f401cb25-665b-4d39-a79c-116521534414 req-37e00069-2eb5-4f08-abec-bafb58837b10 service nova] Unable to find a host for instance 4e4c90a0-14de-401e-80d5-fe4bf684d991. Dropping event network-vif-unplugged {{(pid=117890) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jun 29 08:09:33.325427 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [req-f401cb25-665b-4d39-a79c-116521534414 req-37e00069-2eb5-4f08-abec-bafb58837b10 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.053893 Jun 29 08:09:33.326543 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 369/748] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jun 29 08:09:33 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 55 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Jun 29 08:09:33.446165 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-d9c8c0d6-aa67-4689-a4f7-20fb3c738af3 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:09:33.447074 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-d9c8c0d6-aa67-4689-a4f7-20fb3c738af3 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] [instance: 83a86ef0-c066-44a7-b4eb-e32dce6e0069] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:09:33.463745 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-d9c8c0d6-aa67-4689-a4f7-20fb3c738af3 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:09:33.465334 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-d9c8c0d6-aa67-4689-a4f7-20fb3c738af3 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:09:33.468615 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-d9c8c0d6-aa67-4689-a4f7-20fb3c738af3 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:09:33.470209 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-d9c8c0d6-aa67-4689-a4f7-20fb3c738af3 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:09:33.526455 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-cb6bac78-462a-4306-a881-1c707500c0c0 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:09:33.527602 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-cb6bac78-462a-4306-a881-1c707500c0c0 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] [instance: 4e4c90a0-14de-401e-80d5-fe4bf684d991] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:09:33.539281 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-cb6bac78-462a-4306-a881-1c707500c0c0 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:09:33.540390 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-cb6bac78-462a-4306-a881-1c707500c0c0 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:09:33.542180 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-cb6bac78-462a-4306-a881-1c707500c0c0 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:09:33.543246 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-cb6bac78-462a-4306-a881-1c707500c0c0 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:09:33.981649 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-d9c8c0d6-aa67-4689-a4f7-20fb3c738af3 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de6636a0522642799e43a8f02ee602ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a20f6f9f254aae91c952ee44a4ff74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:09:34.007488 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-d9c8c0d6-aa67-4689-a4f7-20fb3c738af3 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] 10.222.0.43 "GET /compute/v2.1/servers/83a86ef0-c066-44a7-b4eb-e32dce6e0069" status: 200 len: 1521 microversion: 2.1 time: 0.566564 Jun 29 08:09:34.008630 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 380/749] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:09:33 2022] GET /compute/v2.1/servers/83a86ef0-c066-44a7-b4eb-e32dce6e0069 => generated 1521 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 08:09:34.026616 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-cb6bac78-462a-4306-a881-1c707500c0c0 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] 10.222.0.43 "DELETE /compute/v2.1/servers/4e4c90a0-14de-401e-80d5-fe4bf684d991/os-volume_attachments/cbdc277a-7942-42a0-990d-a940eab0c8f5" status: 202 len: 0 microversion: 2.20 time: 0.506308 Jun 29 08:09:34.028230 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 370/750] 10.222.0.43 () {60 vars in 1456 bytes} [Wed Jun 29 08:09:33 2022] DELETE /compute/v2.1/servers/4e4c90a0-14de-401e-80d5-fe4bf684d991/os-volume_attachments/cbdc277a-7942-42a0-990d-a940eab0c8f5 => generated 0 bytes in 509 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 29 08:09:34.101890 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-952eacec-9253-4df6-aaea-73e727436120 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:09:34.102511 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-952eacec-9253-4df6-aaea-73e727436120 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] [instance: 4e4c90a0-14de-401e-80d5-fe4bf684d991] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:09:34.115547 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-952eacec-9253-4df6-aaea-73e727436120 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:09:34.116037 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-952eacec-9253-4df6-aaea-73e727436120 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:09:34.116903 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-952eacec-9253-4df6-aaea-73e727436120 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:09:34.117329 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-952eacec-9253-4df6-aaea-73e727436120 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:09:34.253528 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:09:34.337042 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-952eacec-9253-4df6-aaea-73e727436120 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] 10.222.0.43 "POST /compute/v2.1/servers/4e4c90a0-14de-401e-80d5-fe4bf684d991/action" status: 202 len: 0 microversion: 2.20 time: 0.240235 Jun 29 08:09:34.338046 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 381/751] 10.222.0.43 () {62 vars in 1318 bytes} [Wed Jun 29 08:09:34 2022] POST /compute/v2.1/servers/4e4c90a0-14de-401e-80d5-fe4bf684d991/action => generated 0 bytes in 243 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 29 08:09:34.352295 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-b1a481a9-e48c-4d6f-b9ab-3b9b4cea7bf0 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:09:34.353065 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-b1a481a9-e48c-4d6f-b9ab-3b9b4cea7bf0 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] [instance: 4e4c90a0-14de-401e-80d5-fe4bf684d991] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:09:34.362785 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-b1a481a9-e48c-4d6f-b9ab-3b9b4cea7bf0 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:09:34.363591 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-b1a481a9-e48c-4d6f-b9ab-3b9b4cea7bf0 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:09:34.364803 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-b1a481a9-e48c-4d6f-b9ab-3b9b4cea7bf0 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:09:34.365509 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-b1a481a9-e48c-4d6f-b9ab-3b9b4cea7bf0 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:09:34.631143 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-b1a481a9-e48c-4d6f-b9ab-3b9b4cea7bf0 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:09:34.646118 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-b1a481a9-e48c-4d6f-b9ab-3b9b4cea7bf0 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:09:34.650609 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-b1a481a9-e48c-4d6f-b9ab-3b9b4cea7bf0 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:09:34.654311 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-b1a481a9-e48c-4d6f-b9ab-3b9b4cea7bf0 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] 10.222.0.43 "GET /compute/v2.1/servers/4e4c90a0-14de-401e-80d5-fe4bf684d991" status: 200 len: 1672 microversion: 2.20 time: 0.307727 Jun 29 08:09:34.655743 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 371/752] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 29 08:09:34 2022] GET /compute/v2.1/servers/4e4c90a0-14de-401e-80d5-fe4bf684d991 => generated 1672 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:09:35.039703 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-b84a8fea-6b97-4c72-a7c7-488d44c16fd8 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:09:35.040492 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-b84a8fea-6b97-4c72-a7c7-488d44c16fd8 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] [instance: 83a86ef0-c066-44a7-b4eb-e32dce6e0069] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:09:35.048221 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-b84a8fea-6b97-4c72-a7c7-488d44c16fd8 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:09:35.048771 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-b84a8fea-6b97-4c72-a7c7-488d44c16fd8 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:09:35.050643 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-b84a8fea-6b97-4c72-a7c7-488d44c16fd8 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:09:35.051172 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-b84a8fea-6b97-4c72-a7c7-488d44c16fd8 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:09:35.245535 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-b84a8fea-6b97-4c72-a7c7-488d44c16fd8 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de6636a0522642799e43a8f02ee602ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a20f6f9f254aae91c952ee44a4ff74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:09:35.254727 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-b84a8fea-6b97-4c72-a7c7-488d44c16fd8 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] 10.222.0.43 "GET /compute/v2.1/servers/83a86ef0-c066-44a7-b4eb-e32dce6e0069" status: 200 len: 1577 microversion: 2.1 time: 0.220477 Jun 29 08:09:35.268632 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 382/753] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:09:35 2022] GET /compute/v2.1/servers/83a86ef0-c066-44a7-b4eb-e32dce6e0069 => generated 1577 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:09:35.380900 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [req-03fc3fc7-179c-4045-8b35-bf326b08ad27 req-fbe31412-7e1a-4a4f-8c2e-ad5675a698f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "83a86ef0-c066-44a7-b4eb-e32dce6e0069", "name": "network-vif-unplugged", "status": "completed", "tag": "3828b918-ada6-49b4-b99e-2bfa66c92b2d"}]} {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:09:35.393289 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [req-03fc3fc7-179c-4045-8b35-bf326b08ad27 req-fbe31412-7e1a-4a4f-8c2e-ad5675a698f2 service nova] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:09:35.393740 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [req-03fc3fc7-179c-4045-8b35-bf326b08ad27 req-fbe31412-7e1a-4a4f-8c2e-ad5675a698f2 service nova] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:09:35.407105 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.compute.server_external_events [req-03fc3fc7-179c-4045-8b35-bf326b08ad27 req-fbe31412-7e1a-4a4f-8c2e-ad5675a698f2 service nova] Creating event network-vif-unplugged:3828b918-ada6-49b4-b99e-2bfa66c92b2d for instance 83a86ef0-c066-44a7-b4eb-e32dce6e0069 on hv-cinder-76810 Jun 29 08:09:35.412555 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [req-03fc3fc7-179c-4045-8b35-bf326b08ad27 req-fbe31412-7e1a-4a4f-8c2e-ad5675a698f2 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.040889 Jun 29 08:09:35.413357 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 372/754] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jun 29 08:09:35 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:09:35.675184 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-64905a77-1350-4f40-b168-82ace5609a82 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:09:35.676743 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-64905a77-1350-4f40-b168-82ace5609a82 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] [instance: 4e4c90a0-14de-401e-80d5-fe4bf684d991] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:09:35.683452 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-64905a77-1350-4f40-b168-82ace5609a82 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:09:35.683897 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-64905a77-1350-4f40-b168-82ace5609a82 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:09:35.684839 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-64905a77-1350-4f40-b168-82ace5609a82 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:09:35.685532 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-64905a77-1350-4f40-b168-82ace5609a82 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:09:35.855142 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-64905a77-1350-4f40-b168-82ace5609a82 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:09:35.864723 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-64905a77-1350-4f40-b168-82ace5609a82 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:09:35.866273 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-64905a77-1350-4f40-b168-82ace5609a82 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:09:35.867690 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-64905a77-1350-4f40-b168-82ace5609a82 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] 10.222.0.43 "GET /compute/v2.1/servers/4e4c90a0-14de-401e-80d5-fe4bf684d991" status: 200 len: 1672 microversion: 2.20 time: 0.197316 Jun 29 08:09:35.868254 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 383/755] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 29 08:09:35 2022] GET /compute/v2.1/servers/4e4c90a0-14de-401e-80d5-fe4bf684d991 => generated 1672 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:09:36.282780 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-7d602e26-a6df-4e88-ae86-dcbb6751a7bf tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:09:36.284319 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-7d602e26-a6df-4e88-ae86-dcbb6751a7bf tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] [instance: 83a86ef0-c066-44a7-b4eb-e32dce6e0069] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:09:36.296862 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-7d602e26-a6df-4e88-ae86-dcbb6751a7bf tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:09:36.298008 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-7d602e26-a6df-4e88-ae86-dcbb6751a7bf tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:09:36.299449 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-7d602e26-a6df-4e88-ae86-dcbb6751a7bf tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:09:36.300220 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-7d602e26-a6df-4e88-ae86-dcbb6751a7bf tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:09:36.487059 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-7d602e26-a6df-4e88-ae86-dcbb6751a7bf tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de6636a0522642799e43a8f02ee602ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a20f6f9f254aae91c952ee44a4ff74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:09:36.495410 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-7d602e26-a6df-4e88-ae86-dcbb6751a7bf tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] 10.222.0.43 "GET /compute/v2.1/servers/83a86ef0-c066-44a7-b4eb-e32dce6e0069" status: 200 len: 1577 microversion: 2.1 time: 0.222187 Jun 29 08:09:36.495997 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 373/756] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:09:36 2022] GET /compute/v2.1/servers/83a86ef0-c066-44a7-b4eb-e32dce6e0069 => generated 1577 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:09:36.886921 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-5dfb0615-29fe-4adb-9bfc-78d7818b9541 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:09:36.887532 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-5dfb0615-29fe-4adb-9bfc-78d7818b9541 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] [instance: 4e4c90a0-14de-401e-80d5-fe4bf684d991] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:09:36.894807 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-5dfb0615-29fe-4adb-9bfc-78d7818b9541 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:09:36.895260 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-5dfb0615-29fe-4adb-9bfc-78d7818b9541 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:09:36.896258 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-5dfb0615-29fe-4adb-9bfc-78d7818b9541 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:09:36.896703 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-5dfb0615-29fe-4adb-9bfc-78d7818b9541 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:09:37.048644 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-5dfb0615-29fe-4adb-9bfc-78d7818b9541 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:09:37.058427 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-5dfb0615-29fe-4adb-9bfc-78d7818b9541 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:09:37.060644 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-5dfb0615-29fe-4adb-9bfc-78d7818b9541 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:09:37.062547 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-5dfb0615-29fe-4adb-9bfc-78d7818b9541 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] 10.222.0.43 "GET /compute/v2.1/servers/4e4c90a0-14de-401e-80d5-fe4bf684d991" status: 200 len: 1730 microversion: 2.20 time: 0.179558 Jun 29 08:09:37.063116 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 384/757] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 29 08:09:36 2022] GET /compute/v2.1/servers/4e4c90a0-14de-401e-80d5-fe4bf684d991 => generated 1730 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:09:37.516926 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-b9b5570c-3d3f-438d-b963-c206a7fe8f19 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:09:37.518913 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-b9b5570c-3d3f-438d-b963-c206a7fe8f19 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] [instance: 83a86ef0-c066-44a7-b4eb-e32dce6e0069] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:09:37.531963 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-b9b5570c-3d3f-438d-b963-c206a7fe8f19 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:09:37.533130 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-b9b5570c-3d3f-438d-b963-c206a7fe8f19 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:09:37.539222 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-b9b5570c-3d3f-438d-b963-c206a7fe8f19 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:09:37.539222 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-b9b5570c-3d3f-438d-b963-c206a7fe8f19 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:09:37.721456 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-b9b5570c-3d3f-438d-b963-c206a7fe8f19 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de6636a0522642799e43a8f02ee602ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a20f6f9f254aae91c952ee44a4ff74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:09:37.729721 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-b9b5570c-3d3f-438d-b963-c206a7fe8f19 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] 10.222.0.43 "GET /compute/v2.1/servers/83a86ef0-c066-44a7-b4eb-e32dce6e0069" status: 200 len: 1577 microversion: 2.1 time: 0.218768 Jun 29 08:09:37.730451 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 374/758] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:09:37 2022] GET /compute/v2.1/servers/83a86ef0-c066-44a7-b4eb-e32dce6e0069 => generated 1577 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:09:38.081983 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-85dd7fa0-ac4b-4407-8c85-c293b7c0c147 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:09:38.083460 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-85dd7fa0-ac4b-4407-8c85-c293b7c0c147 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] [instance: 4e4c90a0-14de-401e-80d5-fe4bf684d991] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:09:38.090799 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-85dd7fa0-ac4b-4407-8c85-c293b7c0c147 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:09:38.091610 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-85dd7fa0-ac4b-4407-8c85-c293b7c0c147 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:09:38.093437 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-85dd7fa0-ac4b-4407-8c85-c293b7c0c147 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:09:38.094199 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-85dd7fa0-ac4b-4407-8c85-c293b7c0c147 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:09:38.316158 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-85dd7fa0-ac4b-4407-8c85-c293b7c0c147 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:09:38.330017 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-85dd7fa0-ac4b-4407-8c85-c293b7c0c147 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:09:38.333901 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-85dd7fa0-ac4b-4407-8c85-c293b7c0c147 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:09:38.335364 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-85dd7fa0-ac4b-4407-8c85-c293b7c0c147 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] 10.222.0.43 "GET /compute/v2.1/servers/4e4c90a0-14de-401e-80d5-fe4bf684d991" status: 200 len: 1730 microversion: 2.20 time: 0.257299 Jun 29 08:09:38.336922 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 385/759] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 29 08:09:38 2022] GET /compute/v2.1/servers/4e4c90a0-14de-401e-80d5-fe4bf684d991 => generated 1730 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:09:38.751943 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-dd98b30e-6ede-4784-a06e-741303db5440 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:09:38.754695 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-dd98b30e-6ede-4784-a06e-741303db5440 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] [instance: 83a86ef0-c066-44a7-b4eb-e32dce6e0069] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:09:38.766278 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-dd98b30e-6ede-4784-a06e-741303db5440 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:09:38.767115 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-dd98b30e-6ede-4784-a06e-741303db5440 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:09:38.768340 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-dd98b30e-6ede-4784-a06e-741303db5440 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:09:38.769002 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-dd98b30e-6ede-4784-a06e-741303db5440 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:09:39.009556 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-dd98b30e-6ede-4784-a06e-741303db5440 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de6636a0522642799e43a8f02ee602ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a20f6f9f254aae91c952ee44a4ff74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:09:39.023807 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-dd98b30e-6ede-4784-a06e-741303db5440 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] 10.222.0.43 "GET /compute/v2.1/servers/83a86ef0-c066-44a7-b4eb-e32dce6e0069" status: 200 len: 1577 microversion: 2.1 time: 0.279509 Jun 29 08:09:39.025664 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 375/760] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:09:38 2022] GET /compute/v2.1/servers/83a86ef0-c066-44a7-b4eb-e32dce6e0069 => generated 1577 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:09:39.364583 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-57998f9a-2ca4-4ecd-87b4-1720bc094b61 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:09:39.366753 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-57998f9a-2ca4-4ecd-87b4-1720bc094b61 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] [instance: 4e4c90a0-14de-401e-80d5-fe4bf684d991] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:09:39.381285 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-57998f9a-2ca4-4ecd-87b4-1720bc094b61 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:09:39.382047 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-57998f9a-2ca4-4ecd-87b4-1720bc094b61 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:09:39.383048 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-57998f9a-2ca4-4ecd-87b4-1720bc094b61 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:09:39.383882 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-57998f9a-2ca4-4ecd-87b4-1720bc094b61 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:09:39.590212 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-57998f9a-2ca4-4ecd-87b4-1720bc094b61 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:09:39.605455 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-57998f9a-2ca4-4ecd-87b4-1720bc094b61 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:09:39.608557 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-57998f9a-2ca4-4ecd-87b4-1720bc094b61 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:09:39.610828 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-57998f9a-2ca4-4ecd-87b4-1720bc094b61 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] 10.222.0.43 "GET /compute/v2.1/servers/4e4c90a0-14de-401e-80d5-fe4bf684d991" status: 200 len: 1730 microversion: 2.20 time: 0.250953 Jun 29 08:09:39.611872 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 386/761] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 29 08:09:39 2022] GET /compute/v2.1/servers/4e4c90a0-14de-401e-80d5-fe4bf684d991 => generated 1730 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:09:40.045557 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-96526f65-39b6-4ae0-b420-a2e52a86a4d5 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:09:40.046395 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-96526f65-39b6-4ae0-b420-a2e52a86a4d5 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] [instance: 83a86ef0-c066-44a7-b4eb-e32dce6e0069] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:09:40.053229 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-96526f65-39b6-4ae0-b420-a2e52a86a4d5 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:09:40.053924 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-96526f65-39b6-4ae0-b420-a2e52a86a4d5 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:09:40.054794 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-96526f65-39b6-4ae0-b420-a2e52a86a4d5 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:09:40.055301 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-96526f65-39b6-4ae0-b420-a2e52a86a4d5 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:09:40.217576 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-96526f65-39b6-4ae0-b420-a2e52a86a4d5 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de6636a0522642799e43a8f02ee602ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a20f6f9f254aae91c952ee44a4ff74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:09:40.233438 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-96526f65-39b6-4ae0-b420-a2e52a86a4d5 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] 10.222.0.43 "GET /compute/v2.1/servers/83a86ef0-c066-44a7-b4eb-e32dce6e0069" status: 200 len: 1577 microversion: 2.1 time: 0.193046 Jun 29 08:09:40.234906 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 376/762] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:09:40 2022] GET /compute/v2.1/servers/83a86ef0-c066-44a7-b4eb-e32dce6e0069 => generated 1577 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:09:40.630455 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-100c7532-5e1e-407a-a5ce-ea7d53b1ef0e tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:09:40.631066 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-100c7532-5e1e-407a-a5ce-ea7d53b1ef0e tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] [instance: 4e4c90a0-14de-401e-80d5-fe4bf684d991] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:09:40.637946 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-100c7532-5e1e-407a-a5ce-ea7d53b1ef0e tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:09:40.638392 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-100c7532-5e1e-407a-a5ce-ea7d53b1ef0e tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:09:40.639284 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-100c7532-5e1e-407a-a5ce-ea7d53b1ef0e tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:09:40.639717 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-100c7532-5e1e-407a-a5ce-ea7d53b1ef0e tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:09:40.795920 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-100c7532-5e1e-407a-a5ce-ea7d53b1ef0e tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:09:40.806736 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-100c7532-5e1e-407a-a5ce-ea7d53b1ef0e tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:09:40.808302 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-100c7532-5e1e-407a-a5ce-ea7d53b1ef0e tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:09:40.809629 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-100c7532-5e1e-407a-a5ce-ea7d53b1ef0e tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] 10.222.0.43 "GET /compute/v2.1/servers/4e4c90a0-14de-401e-80d5-fe4bf684d991" status: 200 len: 1730 microversion: 2.20 time: 0.183347 Jun 29 08:09:40.810514 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 387/763] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 29 08:09:40 2022] GET /compute/v2.1/servers/4e4c90a0-14de-401e-80d5-fe4bf684d991 => generated 1730 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:09:41.251821 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-0b223059-083f-4abb-916e-831b1de39fc1 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:09:41.253485 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-0b223059-083f-4abb-916e-831b1de39fc1 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] [instance: 83a86ef0-c066-44a7-b4eb-e32dce6e0069] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:09:41.261647 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-0b223059-083f-4abb-916e-831b1de39fc1 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:09:41.262089 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-0b223059-083f-4abb-916e-831b1de39fc1 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:09:41.262863 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-0b223059-083f-4abb-916e-831b1de39fc1 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:09:41.263299 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-0b223059-083f-4abb-916e-831b1de39fc1 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:09:41.425594 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-0b223059-083f-4abb-916e-831b1de39fc1 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de6636a0522642799e43a8f02ee602ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a20f6f9f254aae91c952ee44a4ff74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:09:41.436479 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-0b223059-083f-4abb-916e-831b1de39fc1 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] 10.222.0.43 "GET /compute/v2.1/servers/83a86ef0-c066-44a7-b4eb-e32dce6e0069" status: 200 len: 1577 microversion: 2.1 time: 0.188090 Jun 29 08:09:41.447246 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 377/764] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:09:41 2022] GET /compute/v2.1/servers/83a86ef0-c066-44a7-b4eb-e32dce6e0069 => generated 1577 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:09:41.830237 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-4b49d3bb-6911-4d4f-bba4-e6629c48dc1c tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:09:41.831746 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-4b49d3bb-6911-4d4f-bba4-e6629c48dc1c tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] [instance: 4e4c90a0-14de-401e-80d5-fe4bf684d991] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:09:41.838982 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-4b49d3bb-6911-4d4f-bba4-e6629c48dc1c tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:09:41.839430 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-4b49d3bb-6911-4d4f-bba4-e6629c48dc1c tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:09:41.840211 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-4b49d3bb-6911-4d4f-bba4-e6629c48dc1c tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:09:41.840644 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-4b49d3bb-6911-4d4f-bba4-e6629c48dc1c tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:09:42.028491 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-4b49d3bb-6911-4d4f-bba4-e6629c48dc1c tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:09:42.039881 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-4b49d3bb-6911-4d4f-bba4-e6629c48dc1c tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:09:42.042413 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-4b49d3bb-6911-4d4f-bba4-e6629c48dc1c tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:09:42.044093 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-4b49d3bb-6911-4d4f-bba4-e6629c48dc1c tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] 10.222.0.43 "GET /compute/v2.1/servers/4e4c90a0-14de-401e-80d5-fe4bf684d991" status: 200 len: 1730 microversion: 2.20 time: 0.218465 Jun 29 08:09:42.046078 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 388/765] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 29 08:09:41 2022] GET /compute/v2.1/servers/4e4c90a0-14de-401e-80d5-fe4bf684d991 => generated 1730 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:09:42.455799 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-46f1c0cb-2c28-4db6-a0eb-ae7928ef6acc tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:09:42.456405 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-46f1c0cb-2c28-4db6-a0eb-ae7928ef6acc tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] [instance: 83a86ef0-c066-44a7-b4eb-e32dce6e0069] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:09:42.462901 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-46f1c0cb-2c28-4db6-a0eb-ae7928ef6acc tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:09:42.463342 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-46f1c0cb-2c28-4db6-a0eb-ae7928ef6acc tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:09:42.464102 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-46f1c0cb-2c28-4db6-a0eb-ae7928ef6acc tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:09:42.464527 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-46f1c0cb-2c28-4db6-a0eb-ae7928ef6acc tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:09:42.633556 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-46f1c0cb-2c28-4db6-a0eb-ae7928ef6acc tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de6636a0522642799e43a8f02ee602ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a20f6f9f254aae91c952ee44a4ff74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:09:42.646592 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-46f1c0cb-2c28-4db6-a0eb-ae7928ef6acc tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] 10.222.0.43 "GET /compute/v2.1/servers/83a86ef0-c066-44a7-b4eb-e32dce6e0069" status: 200 len: 1577 microversion: 2.1 time: 0.195232 Jun 29 08:09:42.647504 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 378/766] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:09:42 2022] GET /compute/v2.1/servers/83a86ef0-c066-44a7-b4eb-e32dce6e0069 => generated 1577 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:09:43.067386 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-7a6c1af8-6d77-4ec6-b443-ff85313d126b tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:09:43.068848 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-7a6c1af8-6d77-4ec6-b443-ff85313d126b tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] [instance: 4e4c90a0-14de-401e-80d5-fe4bf684d991] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:09:43.079829 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-7a6c1af8-6d77-4ec6-b443-ff85313d126b tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:09:43.080615 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-7a6c1af8-6d77-4ec6-b443-ff85313d126b tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:09:43.081895 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-7a6c1af8-6d77-4ec6-b443-ff85313d126b tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:09:43.082946 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-7a6c1af8-6d77-4ec6-b443-ff85313d126b tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:09:43.239961 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-7a6c1af8-6d77-4ec6-b443-ff85313d126b tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:09:43.248587 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-7a6c1af8-6d77-4ec6-b443-ff85313d126b tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:09:43.250247 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-7a6c1af8-6d77-4ec6-b443-ff85313d126b tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:09:43.251442 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-7a6c1af8-6d77-4ec6-b443-ff85313d126b tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] 10.222.0.43 "GET /compute/v2.1/servers/4e4c90a0-14de-401e-80d5-fe4bf684d991" status: 200 len: 1730 microversion: 2.20 time: 0.190686 Jun 29 08:09:43.252007 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 389/767] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 29 08:09:43 2022] GET /compute/v2.1/servers/4e4c90a0-14de-401e-80d5-fe4bf684d991 => generated 1730 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:09:43.663814 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-a14bfc42-219f-4ca1-bdbf-f015ccfc7f38 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:09:43.664806 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-a14bfc42-219f-4ca1-bdbf-f015ccfc7f38 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] [instance: 83a86ef0-c066-44a7-b4eb-e32dce6e0069] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:09:43.685228 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-a14bfc42-219f-4ca1-bdbf-f015ccfc7f38 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:09:43.686548 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-a14bfc42-219f-4ca1-bdbf-f015ccfc7f38 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:09:43.688615 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-a14bfc42-219f-4ca1-bdbf-f015ccfc7f38 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:09:43.689536 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-a14bfc42-219f-4ca1-bdbf-f015ccfc7f38 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:09:43.891746 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-a14bfc42-219f-4ca1-bdbf-f015ccfc7f38 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de6636a0522642799e43a8f02ee602ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a20f6f9f254aae91c952ee44a4ff74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:09:43.900193 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-a14bfc42-219f-4ca1-bdbf-f015ccfc7f38 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] 10.222.0.43 "GET /compute/v2.1/servers/83a86ef0-c066-44a7-b4eb-e32dce6e0069" status: 200 len: 1577 microversion: 2.1 time: 0.240289 Jun 29 08:09:43.900789 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 379/768] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:09:43 2022] GET /compute/v2.1/servers/83a86ef0-c066-44a7-b4eb-e32dce6e0069 => generated 1577 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:09:44.273106 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-e578cdac-4e5d-4dc7-b827-352123083e5a tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:09:44.273663 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-e578cdac-4e5d-4dc7-b827-352123083e5a tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] [instance: 4e4c90a0-14de-401e-80d5-fe4bf684d991] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:09:44.281708 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e578cdac-4e5d-4dc7-b827-352123083e5a tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:09:44.282386 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e578cdac-4e5d-4dc7-b827-352123083e5a tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:09:44.283233 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e578cdac-4e5d-4dc7-b827-352123083e5a tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:09:44.283679 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e578cdac-4e5d-4dc7-b827-352123083e5a tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:09:44.458476 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-e578cdac-4e5d-4dc7-b827-352123083e5a tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:09:44.468314 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-e578cdac-4e5d-4dc7-b827-352123083e5a tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:09:44.470412 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-e578cdac-4e5d-4dc7-b827-352123083e5a tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:09:44.471886 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-e578cdac-4e5d-4dc7-b827-352123083e5a tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] 10.222.0.43 "GET /compute/v2.1/servers/4e4c90a0-14de-401e-80d5-fe4bf684d991" status: 200 len: 1730 microversion: 2.20 time: 0.204054 Jun 29 08:09:44.473071 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 390/769] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 29 08:09:44 2022] GET /compute/v2.1/servers/4e4c90a0-14de-401e-80d5-fe4bf684d991 => generated 1730 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:09:44.918835 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-ee53152e-8e67-414f-a3a7-a4d32fc68852 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:09:44.919469 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-ee53152e-8e67-414f-a3a7-a4d32fc68852 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] [instance: 83a86ef0-c066-44a7-b4eb-e32dce6e0069] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:09:44.926902 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-ee53152e-8e67-414f-a3a7-a4d32fc68852 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:09:44.927347 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-ee53152e-8e67-414f-a3a7-a4d32fc68852 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:09:44.928120 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-ee53152e-8e67-414f-a3a7-a4d32fc68852 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:09:44.928555 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-ee53152e-8e67-414f-a3a7-a4d32fc68852 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:09:45.095254 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-ee53152e-8e67-414f-a3a7-a4d32fc68852 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de6636a0522642799e43a8f02ee602ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a20f6f9f254aae91c952ee44a4ff74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:09:45.098749 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG dbcounter [-] [117890] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=117890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:09:45.103666 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-ee53152e-8e67-414f-a3a7-a4d32fc68852 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] 10.222.0.43 "GET /compute/v2.1/servers/83a86ef0-c066-44a7-b4eb-e32dce6e0069" status: 200 len: 1577 microversion: 2.1 time: 0.188909 Jun 29 08:09:45.104244 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 380/770] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:09:44 2022] GET /compute/v2.1/servers/83a86ef0-c066-44a7-b4eb-e32dce6e0069 => generated 1577 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:09:45.495050 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-b655655d-639b-4ad6-8bcd-38d0acec49a0 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:09:45.495673 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-b655655d-639b-4ad6-8bcd-38d0acec49a0 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] [instance: 4e4c90a0-14de-401e-80d5-fe4bf684d991] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:09:45.503839 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-b655655d-639b-4ad6-8bcd-38d0acec49a0 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:09:45.504585 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-b655655d-639b-4ad6-8bcd-38d0acec49a0 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:09:45.505582 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-b655655d-639b-4ad6-8bcd-38d0acec49a0 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:09:45.506186 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-b655655d-639b-4ad6-8bcd-38d0acec49a0 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:09:45.665318 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-b655655d-639b-4ad6-8bcd-38d0acec49a0 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:09:45.678440 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-b655655d-639b-4ad6-8bcd-38d0acec49a0 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:09:45.680340 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-b655655d-639b-4ad6-8bcd-38d0acec49a0 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:09:45.682303 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-b655655d-639b-4ad6-8bcd-38d0acec49a0 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] 10.222.0.43 "GET /compute/v2.1/servers/4e4c90a0-14de-401e-80d5-fe4bf684d991" status: 200 len: 1730 microversion: 2.20 time: 0.191048 Jun 29 08:09:45.683515 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 391/771] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 29 08:09:45 2022] GET /compute/v2.1/servers/4e4c90a0-14de-401e-80d5-fe4bf684d991 => generated 1730 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:09:46.124448 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-6603c27c-7a6a-46bb-8730-28d43ecf83cf tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:09:46.125386 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-6603c27c-7a6a-46bb-8730-28d43ecf83cf tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] [instance: 83a86ef0-c066-44a7-b4eb-e32dce6e0069] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:09:46.134513 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-6603c27c-7a6a-46bb-8730-28d43ecf83cf tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:09:46.134968 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-6603c27c-7a6a-46bb-8730-28d43ecf83cf tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:09:46.135799 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-6603c27c-7a6a-46bb-8730-28d43ecf83cf tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:09:46.136216 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-6603c27c-7a6a-46bb-8730-28d43ecf83cf tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:09:46.332475 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-6603c27c-7a6a-46bb-8730-28d43ecf83cf tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de6636a0522642799e43a8f02ee602ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a20f6f9f254aae91c952ee44a4ff74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:09:46.352710 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-6603c27c-7a6a-46bb-8730-28d43ecf83cf tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] 10.222.0.43 "GET /compute/v2.1/servers/83a86ef0-c066-44a7-b4eb-e32dce6e0069" status: 200 len: 1577 microversion: 2.1 time: 0.232583 Jun 29 08:09:46.353433 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 381/772] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:09:46 2022] GET /compute/v2.1/servers/83a86ef0-c066-44a7-b4eb-e32dce6e0069 => generated 1577 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 08:09:46.710975 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-d2062296-388f-458a-9269-a862e983ea1a tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:09:46.711608 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-d2062296-388f-458a-9269-a862e983ea1a tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] [instance: 4e4c90a0-14de-401e-80d5-fe4bf684d991] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:09:46.712018 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-b4fd0897-ef99-42c2-8c8e-1193eaf93cd9 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:09:46.712523 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-b4fd0897-ef99-42c2-8c8e-1193eaf93cd9 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] [instance: 57b6d980-40de-4505-a591-20b54645d37c] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:09:46.719745 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-d2062296-388f-458a-9269-a862e983ea1a tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:09:46.720350 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-d2062296-388f-458a-9269-a862e983ea1a tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:09:46.721180 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-d2062296-388f-458a-9269-a862e983ea1a tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:09:46.721622 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-d2062296-388f-458a-9269-a862e983ea1a tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:09:46.721995 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-b4fd0897-ef99-42c2-8c8e-1193eaf93cd9 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:09:46.722891 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-b4fd0897-ef99-42c2-8c8e-1193eaf93cd9 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:09:46.724551 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-b4fd0897-ef99-42c2-8c8e-1193eaf93cd9 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:09:46.725089 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-b4fd0897-ef99-42c2-8c8e-1193eaf93cd9 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:09:46.751363 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-b4fd0897-ef99-42c2-8c8e-1193eaf93cd9 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] 10.222.0.43 "GET /compute/v2.1/servers/57b6d980-40de-4505-a591-20b54645d37c/ips" status: 200 len: 148 microversion: 2.1 time: 0.043363 Jun 29 08:09:46.751955 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 382/773] 10.222.0.43 () {58 vars in 1247 bytes} [Wed Jun 29 08:09:46 2022] GET /compute/v2.1/servers/57b6d980-40de-4505-a591-20b54645d37c/ips => generated 148 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 29 08:09:46.878502 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-d2062296-388f-458a-9269-a862e983ea1a tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:09:46.886822 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-d2062296-388f-458a-9269-a862e983ea1a tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:09:46.888569 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-d2062296-388f-458a-9269-a862e983ea1a tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:09:46.890517 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-d2062296-388f-458a-9269-a862e983ea1a tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] 10.222.0.43 "GET /compute/v2.1/servers/4e4c90a0-14de-401e-80d5-fe4bf684d991" status: 200 len: 1730 microversion: 2.20 time: 0.183294 Jun 29 08:09:46.891103 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 392/774] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 29 08:09:46 2022] GET /compute/v2.1/servers/4e4c90a0-14de-401e-80d5-fe4bf684d991 => generated 1730 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 29 08:09:47.374673 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-abf9941d-5b7c-422f-8bea-040276b489f7 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:09:47.375417 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-abf9941d-5b7c-422f-8bea-040276b489f7 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] [instance: 83a86ef0-c066-44a7-b4eb-e32dce6e0069] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:09:47.382249 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-abf9941d-5b7c-422f-8bea-040276b489f7 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:09:47.382695 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-abf9941d-5b7c-422f-8bea-040276b489f7 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:09:47.383468 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-abf9941d-5b7c-422f-8bea-040276b489f7 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:09:47.383907 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-abf9941d-5b7c-422f-8bea-040276b489f7 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:09:47.539056 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-abf9941d-5b7c-422f-8bea-040276b489f7 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de6636a0522642799e43a8f02ee602ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a20f6f9f254aae91c952ee44a4ff74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:09:47.546815 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-abf9941d-5b7c-422f-8bea-040276b489f7 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] 10.222.0.43 "GET /compute/v2.1/servers/83a86ef0-c066-44a7-b4eb-e32dce6e0069" status: 200 len: 1577 microversion: 2.1 time: 0.178017 Jun 29 08:09:47.547412 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 383/775] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:09:47 2022] GET /compute/v2.1/servers/83a86ef0-c066-44a7-b4eb-e32dce6e0069 => generated 1577 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:09:47.909509 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-6074b1bb-6d7e-47b1-af76-d57af757123d tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:09:47.910123 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-6074b1bb-6d7e-47b1-af76-d57af757123d tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] [instance: 4e4c90a0-14de-401e-80d5-fe4bf684d991] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:09:47.917050 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-6074b1bb-6d7e-47b1-af76-d57af757123d tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:09:47.917498 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-6074b1bb-6d7e-47b1-af76-d57af757123d tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:09:47.918277 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-6074b1bb-6d7e-47b1-af76-d57af757123d tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:09:47.918709 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-6074b1bb-6d7e-47b1-af76-d57af757123d tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:09:48.080101 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-6074b1bb-6d7e-47b1-af76-d57af757123d tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:09:48.088636 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-6074b1bb-6d7e-47b1-af76-d57af757123d tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:09:48.093281 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-6074b1bb-6d7e-47b1-af76-d57af757123d tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:09:48.094806 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-6074b1bb-6d7e-47b1-af76-d57af757123d tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] 10.222.0.43 "GET /compute/v2.1/servers/4e4c90a0-14de-401e-80d5-fe4bf684d991" status: 200 len: 1730 microversion: 2.20 time: 0.190494 Jun 29 08:09:48.105652 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 393/776] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 29 08:09:47 2022] GET /compute/v2.1/servers/4e4c90a0-14de-401e-80d5-fe4bf684d991 => generated 1730 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:09:48.149548 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-ca6e2a82-770d-4cb6-9507-a0babd323c10 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3887aaec-216a-4572-a982-bf3a1b30cd1d"}} {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:09:48.150904 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-ca6e2a82-770d-4cb6-9507-a0babd323c10 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] [instance: 57b6d980-40de-4505-a591-20b54645d37c] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:09:48.157554 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-ca6e2a82-770d-4cb6-9507-a0babd323c10 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:09:48.158004 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-ca6e2a82-770d-4cb6-9507-a0babd323c10 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:09:48.158783 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-ca6e2a82-770d-4cb6-9507-a0babd323c10 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:09:48.159224 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-ca6e2a82-770d-4cb6-9507-a0babd323c10 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:09:48.564574 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-054ff4cd-6d72-4a8d-9e23-10f65d71e185 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:09:48.565228 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-054ff4cd-6d72-4a8d-9e23-10f65d71e185 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] [instance: 83a86ef0-c066-44a7-b4eb-e32dce6e0069] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:09:48.571429 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-054ff4cd-6d72-4a8d-9e23-10f65d71e185 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:09:48.571885 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-054ff4cd-6d72-4a8d-9e23-10f65d71e185 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:09:48.572671 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-054ff4cd-6d72-4a8d-9e23-10f65d71e185 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:09:48.573144 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-054ff4cd-6d72-4a8d-9e23-10f65d71e185 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:09:48.710320 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-054ff4cd-6d72-4a8d-9e23-10f65d71e185 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de6636a0522642799e43a8f02ee602ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a20f6f9f254aae91c952ee44a4ff74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:09:48.719929 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-054ff4cd-6d72-4a8d-9e23-10f65d71e185 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] 10.222.0.43 "GET /compute/v2.1/servers/83a86ef0-c066-44a7-b4eb-e32dce6e0069" status: 200 len: 1577 microversion: 2.1 time: 0.159892 Jun 29 08:09:48.720521 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 394/777] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:09:48 2022] GET /compute/v2.1/servers/83a86ef0-c066-44a7-b4eb-e32dce6e0069 => generated 1577 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 08:09:48.900359 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-ca6e2a82-770d-4cb6-9507-a0babd323c10 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] 10.222.0.43 "POST /compute/v2.1/servers/57b6d980-40de-4505-a591-20b54645d37c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.754385 Jun 29 08:09:48.901114 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 384/778] 10.222.0.43 () {60 vars in 1322 bytes} [Wed Jun 29 08:09:48 2022] POST /compute/v2.1/servers/57b6d980-40de-4505-a591-20b54645d37c/os-volume_attachments => generated 194 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:09:49.114516 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-da2f8aa2-2fb2-41a3-880e-c4c0bae896a1 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:09:49.115259 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-da2f8aa2-2fb2-41a3-880e-c4c0bae896a1 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] [instance: 4e4c90a0-14de-401e-80d5-fe4bf684d991] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:09:49.121813 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-da2f8aa2-2fb2-41a3-880e-c4c0bae896a1 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:09:49.122258 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-da2f8aa2-2fb2-41a3-880e-c4c0bae896a1 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:09:49.124281 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-da2f8aa2-2fb2-41a3-880e-c4c0bae896a1 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:09:49.124965 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-da2f8aa2-2fb2-41a3-880e-c4c0bae896a1 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:09:49.275255 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-da2f8aa2-2fb2-41a3-880e-c4c0bae896a1 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:09:49.283749 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-da2f8aa2-2fb2-41a3-880e-c4c0bae896a1 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:09:49.285498 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-da2f8aa2-2fb2-41a3-880e-c4c0bae896a1 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:09:49.287305 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-da2f8aa2-2fb2-41a3-880e-c4c0bae896a1 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] 10.222.0.43 "GET /compute/v2.1/servers/4e4c90a0-14de-401e-80d5-fe4bf684d991" status: 200 len: 1730 microversion: 2.20 time: 0.176690 Jun 29 08:09:49.287891 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 395/779] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 29 08:09:49 2022] GET /compute/v2.1/servers/4e4c90a0-14de-401e-80d5-fe4bf684d991 => generated 1730 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:09:49.739724 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-2fc80c2a-da7b-487d-9b46-d97da367e7f7 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:09:49.740432 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-2fc80c2a-da7b-487d-9b46-d97da367e7f7 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] [instance: 83a86ef0-c066-44a7-b4eb-e32dce6e0069] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:09:49.747838 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-2fc80c2a-da7b-487d-9b46-d97da367e7f7 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:09:49.748432 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-2fc80c2a-da7b-487d-9b46-d97da367e7f7 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:09:49.750346 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-2fc80c2a-da7b-487d-9b46-d97da367e7f7 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:09:49.751000 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-2fc80c2a-da7b-487d-9b46-d97da367e7f7 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:09:49.925064 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-2fc80c2a-da7b-487d-9b46-d97da367e7f7 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de6636a0522642799e43a8f02ee602ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a20f6f9f254aae91c952ee44a4ff74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:09:49.933085 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-2fc80c2a-da7b-487d-9b46-d97da367e7f7 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] 10.222.0.43 "GET /compute/v2.1/servers/83a86ef0-c066-44a7-b4eb-e32dce6e0069" status: 200 len: 1577 microversion: 2.1 time: 0.198301 Jun 29 08:09:49.933659 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 385/780] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:09:49 2022] GET /compute/v2.1/servers/83a86ef0-c066-44a7-b4eb-e32dce6e0069 => generated 1577 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 08:09:50.307525 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-de784c7e-4c75-4d86-be68-ed9ee1723696 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:09:50.308173 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-de784c7e-4c75-4d86-be68-ed9ee1723696 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] [instance: 4e4c90a0-14de-401e-80d5-fe4bf684d991] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:09:50.315339 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-de784c7e-4c75-4d86-be68-ed9ee1723696 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:09:50.315804 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-de784c7e-4c75-4d86-be68-ed9ee1723696 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:09:50.316640 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-de784c7e-4c75-4d86-be68-ed9ee1723696 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:09:50.317117 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-de784c7e-4c75-4d86-be68-ed9ee1723696 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:09:50.461923 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-de784c7e-4c75-4d86-be68-ed9ee1723696 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:09:50.471884 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-de784c7e-4c75-4d86-be68-ed9ee1723696 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:09:50.473423 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-de784c7e-4c75-4d86-be68-ed9ee1723696 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:09:50.474619 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-de784c7e-4c75-4d86-be68-ed9ee1723696 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] 10.222.0.43 "GET /compute/v2.1/servers/4e4c90a0-14de-401e-80d5-fe4bf684d991" status: 200 len: 1730 microversion: 2.20 time: 0.171130 Jun 29 08:09:50.475199 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 396/781] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 29 08:09:50 2022] GET /compute/v2.1/servers/4e4c90a0-14de-401e-80d5-fe4bf684d991 => generated 1730 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:09:50.952368 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-61b904e6-732d-47e6-9266-593eee037a87 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:09:50.953039 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-61b904e6-732d-47e6-9266-593eee037a87 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] [instance: 83a86ef0-c066-44a7-b4eb-e32dce6e0069] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:09:50.960313 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-61b904e6-732d-47e6-9266-593eee037a87 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:09:50.960754 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-61b904e6-732d-47e6-9266-593eee037a87 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:09:50.961593 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-61b904e6-732d-47e6-9266-593eee037a87 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:09:50.962041 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-61b904e6-732d-47e6-9266-593eee037a87 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:09:51.139767 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-61b904e6-732d-47e6-9266-593eee037a87 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de6636a0522642799e43a8f02ee602ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a20f6f9f254aae91c952ee44a4ff74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:09:51.148182 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-61b904e6-732d-47e6-9266-593eee037a87 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] 10.222.0.43 "GET /compute/v2.1/servers/83a86ef0-c066-44a7-b4eb-e32dce6e0069" status: 200 len: 1577 microversion: 2.1 time: 0.200770 Jun 29 08:09:51.148864 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 386/782] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:09:50 2022] GET /compute/v2.1/servers/83a86ef0-c066-44a7-b4eb-e32dce6e0069 => generated 1577 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:09:51.365995 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [req-139c4d80-361d-4df8-a1fd-4b367755837a req-0ac14ce5-32f2-4e7e-9e38-ba8e1071b8b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e4c90a0-14de-401e-80d5-fe4bf684d991", "name": "network-vif-plugged", "status": "completed", "tag": "747dea80-5c60-451c-bba1-3aabe38a1272"}]} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:09:51.375708 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-139c4d80-361d-4df8-a1fd-4b367755837a req-0ac14ce5-32f2-4e7e-9e38-ba8e1071b8b3 service nova] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:09:51.376448 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-139c4d80-361d-4df8-a1fd-4b367755837a req-0ac14ce5-32f2-4e7e-9e38-ba8e1071b8b3 service nova] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:09:51.399444 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.compute.server_external_events [req-139c4d80-361d-4df8-a1fd-4b367755837a req-0ac14ce5-32f2-4e7e-9e38-ba8e1071b8b3 service nova] Creating event network-vif-plugged:747dea80-5c60-451c-bba1-3aabe38a1272 for instance 4e4c90a0-14de-401e-80d5-fe4bf684d991 on hv-cinder-76810 Jun 29 08:09:51.409487 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [req-139c4d80-361d-4df8-a1fd-4b367755837a req-0ac14ce5-32f2-4e7e-9e38-ba8e1071b8b3 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046953 Jun 29 08:09:51.411129 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 397/783] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jun 29 08:09:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:09:51.493886 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-e22746dd-37be-4ada-aa5d-9cc7215cfbdd tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:09:51.494493 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-e22746dd-37be-4ada-aa5d-9cc7215cfbdd tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] [instance: 4e4c90a0-14de-401e-80d5-fe4bf684d991] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:09:51.502618 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-e22746dd-37be-4ada-aa5d-9cc7215cfbdd tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:09:51.503229 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-e22746dd-37be-4ada-aa5d-9cc7215cfbdd tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:09:51.504634 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-e22746dd-37be-4ada-aa5d-9cc7215cfbdd tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:09:51.505245 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-e22746dd-37be-4ada-aa5d-9cc7215cfbdd tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:09:51.770782 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-e22746dd-37be-4ada-aa5d-9cc7215cfbdd tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:09:51.782100 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-e22746dd-37be-4ada-aa5d-9cc7215cfbdd tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:09:51.783907 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-e22746dd-37be-4ada-aa5d-9cc7215cfbdd tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:09:51.785392 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-e22746dd-37be-4ada-aa5d-9cc7215cfbdd tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] 10.222.0.43 "GET /compute/v2.1/servers/4e4c90a0-14de-401e-80d5-fe4bf684d991" status: 200 len: 1730 microversion: 2.20 time: 0.295359 Jun 29 08:09:51.786701 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 387/784] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 29 08:09:51 2022] GET /compute/v2.1/servers/4e4c90a0-14de-401e-80d5-fe4bf684d991 => generated 1730 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:09:52.167501 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-244ed1dd-4ae5-4f66-838c-0dde6d86832b tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:09:52.168100 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-244ed1dd-4ae5-4f66-838c-0dde6d86832b tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] [instance: 83a86ef0-c066-44a7-b4eb-e32dce6e0069] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:09:52.175208 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-244ed1dd-4ae5-4f66-838c-0dde6d86832b tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:09:52.175901 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-244ed1dd-4ae5-4f66-838c-0dde6d86832b tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:09:52.176792 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-244ed1dd-4ae5-4f66-838c-0dde6d86832b tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:09:52.177261 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-244ed1dd-4ae5-4f66-838c-0dde6d86832b tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:09:52.181874 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:09:52.355591 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-244ed1dd-4ae5-4f66-838c-0dde6d86832b tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de6636a0522642799e43a8f02ee602ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a20f6f9f254aae91c952ee44a4ff74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:09:52.365690 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-244ed1dd-4ae5-4f66-838c-0dde6d86832b tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] 10.222.0.43 "GET /compute/v2.1/servers/83a86ef0-c066-44a7-b4eb-e32dce6e0069" status: 200 len: 1577 microversion: 2.1 time: 0.202338 Jun 29 08:09:52.366502 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 398/785] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:09:52 2022] GET /compute/v2.1/servers/83a86ef0-c066-44a7-b4eb-e32dce6e0069 => generated 1577 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:09:52.807719 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-3488e791-b731-4a49-b3d6-aaad25694623 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:09:52.809258 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-3488e791-b731-4a49-b3d6-aaad25694623 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] [instance: 4e4c90a0-14de-401e-80d5-fe4bf684d991] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:09:52.818650 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-3488e791-b731-4a49-b3d6-aaad25694623 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:09:52.819359 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-3488e791-b731-4a49-b3d6-aaad25694623 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:09:52.820405 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-3488e791-b731-4a49-b3d6-aaad25694623 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:09:52.821986 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-3488e791-b731-4a49-b3d6-aaad25694623 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:09:53.038437 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-3488e791-b731-4a49-b3d6-aaad25694623 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:09:53.047348 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-3488e791-b731-4a49-b3d6-aaad25694623 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:09:53.049759 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-3488e791-b731-4a49-b3d6-aaad25694623 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:09:53.051917 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-3488e791-b731-4a49-b3d6-aaad25694623 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] 10.222.0.43 "GET /compute/v2.1/servers/4e4c90a0-14de-401e-80d5-fe4bf684d991" status: 200 len: 1730 microversion: 2.20 time: 0.249730 Jun 29 08:09:53.052949 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 388/786] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 29 08:09:52 2022] GET /compute/v2.1/servers/4e4c90a0-14de-401e-80d5-fe4bf684d991 => generated 1730 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:09:53.386666 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-e2644e8b-f044-4112-8f5d-64217554b799 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:09:53.387462 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-e2644e8b-f044-4112-8f5d-64217554b799 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] [instance: 83a86ef0-c066-44a7-b4eb-e32dce6e0069] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:09:53.398568 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e2644e8b-f044-4112-8f5d-64217554b799 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:09:53.399372 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e2644e8b-f044-4112-8f5d-64217554b799 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:09:53.400560 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e2644e8b-f044-4112-8f5d-64217554b799 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:09:53.401343 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e2644e8b-f044-4112-8f5d-64217554b799 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:09:53.446104 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [req-dae7e8ff-3b53-4a90-9d08-fd24ebc8c727 req-7a140a3a-8696-472a-b028-e6f2d42ab9f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "83a86ef0-c066-44a7-b4eb-e32dce6e0069", "name": "network-vif-plugged", "status": "completed", "tag": "3828b918-ada6-49b4-b99e-2bfa66c92b2d"}]} {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:09:53.463398 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [req-dae7e8ff-3b53-4a90-9d08-fd24ebc8c727 req-7a140a3a-8696-472a-b028-e6f2d42ab9f2 service nova] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:09:53.464283 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [req-dae7e8ff-3b53-4a90-9d08-fd24ebc8c727 req-7a140a3a-8696-472a-b028-e6f2d42ab9f2 service nova] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:09:53.479408 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.compute.server_external_events [req-dae7e8ff-3b53-4a90-9d08-fd24ebc8c727 req-7a140a3a-8696-472a-b028-e6f2d42ab9f2 service nova] Creating event network-vif-plugged:3828b918-ada6-49b4-b99e-2bfa66c92b2d for instance 83a86ef0-c066-44a7-b4eb-e32dce6e0069 on hv-cinder-76810 Jun 29 08:09:53.487815 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [req-dae7e8ff-3b53-4a90-9d08-fd24ebc8c727 req-7a140a3a-8696-472a-b028-e6f2d42ab9f2 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045977 Jun 29 08:09:53.495237 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 389/787] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jun 29 08:09:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 29 08:09:53.591009 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-e2644e8b-f044-4112-8f5d-64217554b799 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de6636a0522642799e43a8f02ee602ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a20f6f9f254aae91c952ee44a4ff74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:09:53.604125 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-e2644e8b-f044-4112-8f5d-64217554b799 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] 10.222.0.43 "GET /compute/v2.1/servers/83a86ef0-c066-44a7-b4eb-e32dce6e0069" status: 200 len: 1577 microversion: 2.1 time: 0.222424 Jun 29 08:09:53.606670 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 399/788] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:09:53 2022] GET /compute/v2.1/servers/83a86ef0-c066-44a7-b4eb-e32dce6e0069 => generated 1577 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:09:54.073145 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-11f9fa7e-e1a3-4316-a165-f850c427b265 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:09:54.073979 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-11f9fa7e-e1a3-4316-a165-f850c427b265 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] [instance: 4e4c90a0-14de-401e-80d5-fe4bf684d991] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:09:54.082828 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-11f9fa7e-e1a3-4316-a165-f850c427b265 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:09:54.083434 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-11f9fa7e-e1a3-4316-a165-f850c427b265 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:09:54.084419 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-11f9fa7e-e1a3-4316-a165-f850c427b265 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:09:54.084925 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-11f9fa7e-e1a3-4316-a165-f850c427b265 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:09:54.266709 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-11f9fa7e-e1a3-4316-a165-f850c427b265 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:09:54.275073 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-11f9fa7e-e1a3-4316-a165-f850c427b265 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:09:54.276488 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-11f9fa7e-e1a3-4316-a165-f850c427b265 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:09:54.277699 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-11f9fa7e-e1a3-4316-a165-f850c427b265 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] 10.222.0.43 "GET /compute/v2.1/servers/4e4c90a0-14de-401e-80d5-fe4bf684d991" status: 200 len: 1717 microversion: 2.20 time: 0.209870 Jun 29 08:09:54.278251 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 390/789] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 29 08:09:54 2022] GET /compute/v2.1/servers/4e4c90a0-14de-401e-80d5-fe4bf684d991 => generated 1717 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 29 08:09:54.625123 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-165a5c50-2ad4-4d2f-b9ce-311601d77789 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:09:54.625834 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-165a5c50-2ad4-4d2f-b9ce-311601d77789 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] [instance: 83a86ef0-c066-44a7-b4eb-e32dce6e0069] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:09:54.632281 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-165a5c50-2ad4-4d2f-b9ce-311601d77789 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:09:54.632731 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-165a5c50-2ad4-4d2f-b9ce-311601d77789 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:09:54.633549 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-165a5c50-2ad4-4d2f-b9ce-311601d77789 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:09:54.633987 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-165a5c50-2ad4-4d2f-b9ce-311601d77789 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:09:54.781145 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-165a5c50-2ad4-4d2f-b9ce-311601d77789 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de6636a0522642799e43a8f02ee602ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a20f6f9f254aae91c952ee44a4ff74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:09:54.789301 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-165a5c50-2ad4-4d2f-b9ce-311601d77789 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] 10.222.0.43 "GET /compute/v2.1/servers/83a86ef0-c066-44a7-b4eb-e32dce6e0069" status: 200 len: 1577 microversion: 2.1 time: 0.169736 Jun 29 08:09:54.789879 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 400/790] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:09:54 2022] GET /compute/v2.1/servers/83a86ef0-c066-44a7-b4eb-e32dce6e0069 => generated 1577 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:09:55.812563 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-903d13ae-e93e-4124-9144-2d4d3b3a55e0 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:09:55.813745 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-903d13ae-e93e-4124-9144-2d4d3b3a55e0 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] [instance: 83a86ef0-c066-44a7-b4eb-e32dce6e0069] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:09:55.818698 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG dbcounter [-] [117890] Writing DB stats nova_api:SELECT=66 {{(pid=117890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:09:55.830915 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-903d13ae-e93e-4124-9144-2d4d3b3a55e0 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:09:55.831709 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-903d13ae-e93e-4124-9144-2d4d3b3a55e0 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:09:55.833165 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-903d13ae-e93e-4124-9144-2d4d3b3a55e0 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:09:55.833700 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-903d13ae-e93e-4124-9144-2d4d3b3a55e0 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:09:56.006886 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-903d13ae-e93e-4124-9144-2d4d3b3a55e0 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de6636a0522642799e43a8f02ee602ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a20f6f9f254aae91c952ee44a4ff74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:09:56.020632 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-903d13ae-e93e-4124-9144-2d4d3b3a55e0 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] 10.222.0.43 "GET /compute/v2.1/servers/83a86ef0-c066-44a7-b4eb-e32dce6e0069" status: 200 len: 1564 microversion: 2.1 time: 0.216624 Jun 29 08:09:56.021586 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 391/791] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:09:55 2022] GET /compute/v2.1/servers/83a86ef0-c066-44a7-b4eb-e32dce6e0069 => generated 1564 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:09:57.625020 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-39c8d0d9-7d72-4c5c-a093-a1c67d0e1cc0 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Action: 'create', calling method: .version_select at 0x7f72410a1c10>, body: {"keypair": {"name": "tempest-keypair-1557715134", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDSj34sYsySz83jlU2kQbd4Pw8pqM+3ndL4e4mjC2iUrzJno8Gtk7g6VMhtpzvuIc+la+Ietrbv26g1/+NqjI2B2B4roLmruCv22CsCC96Pg5ZuEosEatEdTDCZDFoXdag=="}} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:09:57.631728 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_api:SELECT=62 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:09:57.645210 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.quota [None req-39c8d0d9-7d72-4c5c-a093-a1c67d0e1cc0 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Getting quotas for project a4df15f6a6dd45dab12d0b724076a23e. Resources: {'key_pairs'} {{(pid=117889) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 29 08:09:57.649311 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.quota [None req-39c8d0d9-7d72-4c5c-a093-a1c67d0e1cc0 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Getting quotas for user 4873db0f2fbf4a77a617f2102a5ccfae and project a4df15f6a6dd45dab12d0b724076a23e. Resources: {'key_pairs'} {{(pid=117889) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 29 08:09:57.674722 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-39c8d0d9-7d72-4c5c-a093-a1c67d0e1cc0 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.055536 Jun 29 08:09:57.675587 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 401/792] 10.222.0.43 () {60 vars in 1158 bytes} [Wed Jun 29 08:09:57 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 29 08:09:59.591200 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-9114c071-4916-4071-9dbc-5b5c86ef8d89 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1618463511", "imageRef": "5d2148a0-3628-4eff-88e9-5686abc0d33e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "501bffb4-f18b-4ba3-b604-4fd9c7554413"}], "security_groups": [{"name": "tempest-securitygroup--1994529531"}], "key_name": "tempest-keypair-1557715134", "user_data": "}} {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:09:59.700337 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.network.neutron [None req-9114c071-4916-4071-9dbc-5b5c86ef8d89 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] validate_networks() for [('501bffb4-f18b-4ba3-b604-4fd9c7554413', None, None, None, None, None)] {{(pid=117890) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 29 08:10:00.186056 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.virt.hardware [None req-9114c071-4916-4071-9dbc-5b5c86ef8d89 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Flavor limits 0:0:0 {{(pid=117890) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 29 08:10:00.186661 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.virt.hardware [None req-9114c071-4916-4071-9dbc-5b5c86ef8d89 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Image limits 0:0:0 {{(pid=117890) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 29 08:10:00.187152 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.virt.hardware [None req-9114c071-4916-4071-9dbc-5b5c86ef8d89 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Flavor pref 0:0:0 {{(pid=117890) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 29 08:10:00.187602 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.virt.hardware [None req-9114c071-4916-4071-9dbc-5b5c86ef8d89 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Image pref 0:0:0 {{(pid=117890) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 29 08:10:00.188019 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.virt.hardware [None req-9114c071-4916-4071-9dbc-5b5c86ef8d89 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117890) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 29 08:10:00.197324 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-9114c071-4916-4071-9dbc-5b5c86ef8d89 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:10:00.197797 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-9114c071-4916-4071-9dbc-5b5c86ef8d89 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:10:00.198679 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-9114c071-4916-4071-9dbc-5b5c86ef8d89 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:10:00.199122 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-9114c071-4916-4071-9dbc-5b5c86ef8d89 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:10:00.224361 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.quota [None req-9114c071-4916-4071-9dbc-5b5c86ef8d89 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Getting quotas for project a4df15f6a6dd45dab12d0b724076a23e. Resources: {'ram', 'instances', 'cores'} {{(pid=117890) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 29 08:10:00.229880 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.quota [None req-9114c071-4916-4071-9dbc-5b5c86ef8d89 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Getting quotas for user 4873db0f2fbf4a77a617f2102a5ccfae and project a4df15f6a6dd45dab12d0b724076a23e. Resources: {'ram', 'instances', 'cores'} {{(pid=117890) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 29 08:10:00.242221 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-9114c071-4916-4071-9dbc-5b5c86ef8d89 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Going to run 1 instances... {{(pid=117890) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 29 08:10:00.244600 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-9114c071-4916-4071-9dbc-5b5c86ef8d89 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] [instance: 7c7721f2-e567-4e6f-aefd-d852fa3fe37a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5d2148a0-3628-4eff-88e9-5686abc0d33e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117890) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 29 08:10:00.299184 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-9114c071-4916-4071-9dbc-5b5c86ef8d89 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.712224 Jun 29 08:10:00.300147 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 392/793] 10.222.0.43 () {60 vars in 1146 bytes} [Wed Jun 29 08:09:59 2022] POST /compute/v2.1/servers => generated 402 bytes in 714 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 29 08:10:00.311400 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-8de7e284-2612-44fb-89ec-dff7c015d409 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:10:00.311975 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-8de7e284-2612-44fb-89ec-dff7c015d409 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] [instance: 7c7721f2-e567-4e6f-aefd-d852fa3fe37a] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:10:00.371173 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-8de7e284-2612-44fb-89ec-dff7c015d409 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4873db0f2fbf4a77a617f2102a5ccfae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4df15f6a6dd45dab12d0b724076a23e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:10:00.380123 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-8de7e284-2612-44fb-89ec-dff7c015d409 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] 10.222.0.43 "GET /compute/v2.1/servers/7c7721f2-e567-4e6f-aefd-d852fa3fe37a" status: 200 len: 1242 microversion: 2.1 time: 0.073806 Jun 29 08:10:00.381816 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 402/794] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:10:00 2022] GET /compute/v2.1/servers/7c7721f2-e567-4e6f-aefd-d852fa3fe37a => generated 1242 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:10:01.399786 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-a3ba5692-dfa8-454f-ac73-cf8a2bcca5ee tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:10:01.400418 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-a3ba5692-dfa8-454f-ac73-cf8a2bcca5ee tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] [instance: 7c7721f2-e567-4e6f-aefd-d852fa3fe37a] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:10:01.407412 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-a3ba5692-dfa8-454f-ac73-cf8a2bcca5ee tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:10:01.407862 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-a3ba5692-dfa8-454f-ac73-cf8a2bcca5ee tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:10:01.408639 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-a3ba5692-dfa8-454f-ac73-cf8a2bcca5ee tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:10:01.409093 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-a3ba5692-dfa8-454f-ac73-cf8a2bcca5ee tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:10:01.487450 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-a3ba5692-dfa8-454f-ac73-cf8a2bcca5ee tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4873db0f2fbf4a77a617f2102a5ccfae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4df15f6a6dd45dab12d0b724076a23e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:10:01.499504 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-a3ba5692-dfa8-454f-ac73-cf8a2bcca5ee tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] 10.222.0.43 "GET /compute/v2.1/servers/7c7721f2-e567-4e6f-aefd-d852fa3fe37a" status: 200 len: 1302 microversion: 2.1 time: 0.104000 Jun 29 08:10:01.500102 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 393/795] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:10:01 2022] GET /compute/v2.1/servers/7c7721f2-e567-4e6f-aefd-d852fa3fe37a => generated 1302 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:10:02.379566 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-845c97bd-41d8-4fe7-b3f9-3e8e725387fa tempest-VolumesActionsTest-246618099 tempest-VolumesActionsTest-246618099-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1928825261", "imageRef": "5d2148a0-3628-4eff-88e9-5686abc0d33e", "flavorRef": "452", "networks": [{"uuid": "337273a9-9ac4-41ec-a7d5-038bc1a82bb8"}]}} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:10:02.438162 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.network.neutron [None req-845c97bd-41d8-4fe7-b3f9-3e8e725387fa tempest-VolumesActionsTest-246618099 tempest-VolumesActionsTest-246618099-project] validate_networks() for [('337273a9-9ac4-41ec-a7d5-038bc1a82bb8', None, None, None, None, None)] {{(pid=117889) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 29 08:10:02.517348 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-dbe11c27-4a1b-4df6-8afe-17f22e01bac5 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:10:02.518802 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-dbe11c27-4a1b-4df6-8afe-17f22e01bac5 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] [instance: 7c7721f2-e567-4e6f-aefd-d852fa3fe37a] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:10:02.526081 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-dbe11c27-4a1b-4df6-8afe-17f22e01bac5 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:10:02.526788 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-dbe11c27-4a1b-4df6-8afe-17f22e01bac5 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:10:02.527744 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-dbe11c27-4a1b-4df6-8afe-17f22e01bac5 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:10:02.528339 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-dbe11c27-4a1b-4df6-8afe-17f22e01bac5 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:10:02.780496 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-dbe11c27-4a1b-4df6-8afe-17f22e01bac5 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4873db0f2fbf4a77a617f2102a5ccfae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4df15f6a6dd45dab12d0b724076a23e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:10:02.789148 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-dbe11c27-4a1b-4df6-8afe-17f22e01bac5 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] 10.222.0.43 "GET /compute/v2.1/servers/7c7721f2-e567-4e6f-aefd-d852fa3fe37a" status: 200 len: 1368 microversion: 2.1 time: 0.277094 Jun 29 08:10:02.790116 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 394/796] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:10:02 2022] GET /compute/v2.1/servers/7c7721f2-e567-4e6f-aefd-d852fa3fe37a => generated 1368 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 08:10:02.871508 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.virt.hardware [None req-845c97bd-41d8-4fe7-b3f9-3e8e725387fa tempest-VolumesActionsTest-246618099 tempest-VolumesActionsTest-246618099-project] Flavor limits 0:0:0 {{(pid=117889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 29 08:10:02.871981 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.virt.hardware [None req-845c97bd-41d8-4fe7-b3f9-3e8e725387fa tempest-VolumesActionsTest-246618099 tempest-VolumesActionsTest-246618099-project] Image limits 0:0:0 {{(pid=117889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 29 08:10:02.872472 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.virt.hardware [None req-845c97bd-41d8-4fe7-b3f9-3e8e725387fa tempest-VolumesActionsTest-246618099 tempest-VolumesActionsTest-246618099-project] Flavor pref 0:0:0 {{(pid=117889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 29 08:10:02.872877 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.virt.hardware [None req-845c97bd-41d8-4fe7-b3f9-3e8e725387fa tempest-VolumesActionsTest-246618099 tempest-VolumesActionsTest-246618099-project] Image pref 0:0:0 {{(pid=117889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 29 08:10:02.873385 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.virt.hardware [None req-845c97bd-41d8-4fe7-b3f9-3e8e725387fa tempest-VolumesActionsTest-246618099 tempest-VolumesActionsTest-246618099-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 29 08:10:02.882538 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-845c97bd-41d8-4fe7-b3f9-3e8e725387fa tempest-VolumesActionsTest-246618099 tempest-VolumesActionsTest-246618099-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:10:02.882987 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-845c97bd-41d8-4fe7-b3f9-3e8e725387fa tempest-VolumesActionsTest-246618099 tempest-VolumesActionsTest-246618099-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:10:02.883787 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-845c97bd-41d8-4fe7-b3f9-3e8e725387fa tempest-VolumesActionsTest-246618099 tempest-VolumesActionsTest-246618099-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:10:02.884214 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-845c97bd-41d8-4fe7-b3f9-3e8e725387fa tempest-VolumesActionsTest-246618099 tempest-VolumesActionsTest-246618099-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:10:02.901327 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.quota [None req-845c97bd-41d8-4fe7-b3f9-3e8e725387fa tempest-VolumesActionsTest-246618099 tempest-VolumesActionsTest-246618099-project] Getting quotas for project 941e14f704b74aa7afe5ef3a75a3f24b. Resources: {'ram', 'instances', 'cores'} {{(pid=117889) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 29 08:10:02.905469 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.quota [None req-845c97bd-41d8-4fe7-b3f9-3e8e725387fa tempest-VolumesActionsTest-246618099 tempest-VolumesActionsTest-246618099-project] Getting quotas for user b887b672801d436a80fde4c5b2f8ad61 and project 941e14f704b74aa7afe5ef3a75a3f24b. Resources: {'ram', 'instances', 'cores'} {{(pid=117889) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 29 08:10:02.917188 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-845c97bd-41d8-4fe7-b3f9-3e8e725387fa tempest-VolumesActionsTest-246618099 tempest-VolumesActionsTest-246618099-project] Going to run 1 instances... {{(pid=117889) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 29 08:10:02.919382 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-845c97bd-41d8-4fe7-b3f9-3e8e725387fa tempest-VolumesActionsTest-246618099 tempest-VolumesActionsTest-246618099-project] [instance: 1daf6093-9730-4221-9de3-11fa5735675f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5d2148a0-3628-4eff-88e9-5686abc0d33e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117889) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 29 08:10:02.969126 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-845c97bd-41d8-4fe7-b3f9-3e8e725387fa tempest-VolumesActionsTest-246618099 tempest-VolumesActionsTest-246618099-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.593400 Jun 29 08:10:02.970402 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 403/797] 10.222.0.43 () {60 vars in 1146 bytes} [Wed Jun 29 08:10:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 596 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 29 08:10:02.980392 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-27b82ea9-c4fa-4327-9f0f-87d368439969 tempest-VolumesActionsTest-246618099 tempest-VolumesActionsTest-246618099-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:10:02.981031 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-27b82ea9-c4fa-4327-9f0f-87d368439969 tempest-VolumesActionsTest-246618099 tempest-VolumesActionsTest-246618099-project] [instance: 1daf6093-9730-4221-9de3-11fa5735675f] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:10:03.056459 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-27b82ea9-c4fa-4327-9f0f-87d368439969 tempest-VolumesActionsTest-246618099 tempest-VolumesActionsTest-246618099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b887b672801d436a80fde4c5b2f8ad61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '941e14f704b74aa7afe5ef3a75a3f24b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:10:03.066327 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-27b82ea9-c4fa-4327-9f0f-87d368439969 tempest-VolumesActionsTest-246618099 tempest-VolumesActionsTest-246618099-project] 10.222.0.43 "GET /compute/v2.1/servers/1daf6093-9730-4221-9de3-11fa5735675f" status: 200 len: 1214 microversion: 2.1 time: 0.089790 Jun 29 08:10:03.067108 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 395/798] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:10:02 2022] GET /compute/v2.1/servers/1daf6093-9730-4221-9de3-11fa5735675f => generated 1214 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:10:03.310091 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [req-58269398-314e-49c5-93cf-8280569f75cb req-9ace9b27-a019-4031-bb60-64e51c7af020 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c7721f2-e567-4e6f-aefd-d852fa3fe37a", "tag": "4d314f56-e850-4f57-8290-c2635e548696"}]} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:10:03.327568 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-58269398-314e-49c5-93cf-8280569f75cb req-9ace9b27-a019-4031-bb60-64e51c7af020 service nova] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:10:03.328277 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-58269398-314e-49c5-93cf-8280569f75cb req-9ace9b27-a019-4031-bb60-64e51c7af020 service nova] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:10:03.342731 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.compute.server_external_events [req-58269398-314e-49c5-93cf-8280569f75cb req-9ace9b27-a019-4031-bb60-64e51c7af020 service nova] Creating event network-changed:4d314f56-e850-4f57-8290-c2635e548696 for instance 7c7721f2-e567-4e6f-aefd-d852fa3fe37a on hv-cinder-76810 Jun 29 08:10:03.352794 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [req-58269398-314e-49c5-93cf-8280569f75cb req-9ace9b27-a019-4031-bb60-64e51c7af020 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051910 Jun 29 08:10:03.353527 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 404/799] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jun 29 08:10:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:10:03.808405 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-110d3e72-a574-4d6b-95c3-9ca1870c927e tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:10:03.809065 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-110d3e72-a574-4d6b-95c3-9ca1870c927e tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] [instance: 7c7721f2-e567-4e6f-aefd-d852fa3fe37a] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:10:03.817073 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-110d3e72-a574-4d6b-95c3-9ca1870c927e tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:10:03.817329 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-110d3e72-a574-4d6b-95c3-9ca1870c927e tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:10:03.817939 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-110d3e72-a574-4d6b-95c3-9ca1870c927e tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:10:03.819043 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-110d3e72-a574-4d6b-95c3-9ca1870c927e tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:10:03.956398 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-110d3e72-a574-4d6b-95c3-9ca1870c927e tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4873db0f2fbf4a77a617f2102a5ccfae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4df15f6a6dd45dab12d0b724076a23e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:10:03.963917 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-110d3e72-a574-4d6b-95c3-9ca1870c927e tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] 10.222.0.43 "GET /compute/v2.1/servers/7c7721f2-e567-4e6f-aefd-d852fa3fe37a" status: 200 len: 1368 microversion: 2.1 time: 0.159590 Jun 29 08:10:03.964418 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 396/800] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:10:03 2022] GET /compute/v2.1/servers/7c7721f2-e567-4e6f-aefd-d852fa3fe37a => generated 1368 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:10:04.084388 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-091f279c-420c-45bd-bb3a-21f134402866 tempest-VolumesActionsTest-246618099 tempest-VolumesActionsTest-246618099-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:10:04.085115 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-091f279c-420c-45bd-bb3a-21f134402866 tempest-VolumesActionsTest-246618099 tempest-VolumesActionsTest-246618099-project] [instance: 1daf6093-9730-4221-9de3-11fa5735675f] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:10:04.091452 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-091f279c-420c-45bd-bb3a-21f134402866 tempest-VolumesActionsTest-246618099 tempest-VolumesActionsTest-246618099-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:10:04.091898 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-091f279c-420c-45bd-bb3a-21f134402866 tempest-VolumesActionsTest-246618099 tempest-VolumesActionsTest-246618099-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:10:04.092662 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-091f279c-420c-45bd-bb3a-21f134402866 tempest-VolumesActionsTest-246618099 tempest-VolumesActionsTest-246618099-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:10:04.093127 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-091f279c-420c-45bd-bb3a-21f134402866 tempest-VolumesActionsTest-246618099 tempest-VolumesActionsTest-246618099-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:10:04.155558 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-091f279c-420c-45bd-bb3a-21f134402866 tempest-VolumesActionsTest-246618099 tempest-VolumesActionsTest-246618099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b887b672801d436a80fde4c5b2f8ad61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '941e14f704b74aa7afe5ef3a75a3f24b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:10:04.162965 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-091f279c-420c-45bd-bb3a-21f134402866 tempest-VolumesActionsTest-246618099 tempest-VolumesActionsTest-246618099-project] 10.222.0.43 "GET /compute/v2.1/servers/1daf6093-9730-4221-9de3-11fa5735675f" status: 200 len: 1274 microversion: 2.1 time: 0.083515 Jun 29 08:10:04.163531 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 405/801] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:10:04 2022] GET /compute/v2.1/servers/1daf6093-9730-4221-9de3-11fa5735675f => generated 1274 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:10:04.981741 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-815a9da0-ddc7-4ecf-9bfe-26feadda766b tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:10:04.983057 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-815a9da0-ddc7-4ecf-9bfe-26feadda766b tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] [instance: 7c7721f2-e567-4e6f-aefd-d852fa3fe37a] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:10:04.990125 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-815a9da0-ddc7-4ecf-9bfe-26feadda766b tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:10:04.990705 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-815a9da0-ddc7-4ecf-9bfe-26feadda766b tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:10:04.991479 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-815a9da0-ddc7-4ecf-9bfe-26feadda766b tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:10:04.992755 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-815a9da0-ddc7-4ecf-9bfe-26feadda766b tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:10:05.167768 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-815a9da0-ddc7-4ecf-9bfe-26feadda766b tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4873db0f2fbf4a77a617f2102a5ccfae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4df15f6a6dd45dab12d0b724076a23e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:10:05.177034 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-815a9da0-ddc7-4ecf-9bfe-26feadda766b tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] 10.222.0.43 "GET /compute/v2.1/servers/7c7721f2-e567-4e6f-aefd-d852fa3fe37a" status: 200 len: 1368 microversion: 2.1 time: 0.200324 Jun 29 08:10:05.177705 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 397/802] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:10:04 2022] GET /compute/v2.1/servers/7c7721f2-e567-4e6f-aefd-d852fa3fe37a => generated 1368 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:10:05.181969 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-3ed8d250-29e7-464f-8cdb-870e2afcfa9a tempest-VolumesActionsTest-246618099 tempest-VolumesActionsTest-246618099-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:10:05.182564 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-3ed8d250-29e7-464f-8cdb-870e2afcfa9a tempest-VolumesActionsTest-246618099 tempest-VolumesActionsTest-246618099-project] [instance: 1daf6093-9730-4221-9de3-11fa5735675f] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:10:05.190384 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-3ed8d250-29e7-464f-8cdb-870e2afcfa9a tempest-VolumesActionsTest-246618099 tempest-VolumesActionsTest-246618099-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:10:05.190831 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-3ed8d250-29e7-464f-8cdb-870e2afcfa9a tempest-VolumesActionsTest-246618099 tempest-VolumesActionsTest-246618099-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:10:05.191623 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-3ed8d250-29e7-464f-8cdb-870e2afcfa9a tempest-VolumesActionsTest-246618099 tempest-VolumesActionsTest-246618099-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:10:05.192060 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-3ed8d250-29e7-464f-8cdb-870e2afcfa9a tempest-VolumesActionsTest-246618099 tempest-VolumesActionsTest-246618099-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:10:05.277226 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-3ed8d250-29e7-464f-8cdb-870e2afcfa9a tempest-VolumesActionsTest-246618099 tempest-VolumesActionsTest-246618099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b887b672801d436a80fde4c5b2f8ad61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '941e14f704b74aa7afe5ef3a75a3f24b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:10:05.289581 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-3ed8d250-29e7-464f-8cdb-870e2afcfa9a tempest-VolumesActionsTest-246618099 tempest-VolumesActionsTest-246618099-project] 10.222.0.43 "GET /compute/v2.1/servers/1daf6093-9730-4221-9de3-11fa5735675f" status: 200 len: 1272 microversion: 2.1 time: 0.112249 Jun 29 08:10:05.290910 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 406/803] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:10:05 2022] GET /compute/v2.1/servers/1daf6093-9730-4221-9de3-11fa5735675f => generated 1272 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 08:10:06.194055 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-5a343b7c-e29d-4198-bd4a-a44cff868fe4 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:10:06.194759 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-5a343b7c-e29d-4198-bd4a-a44cff868fe4 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] [instance: 7c7721f2-e567-4e6f-aefd-d852fa3fe37a] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:10:06.201318 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-5a343b7c-e29d-4198-bd4a-a44cff868fe4 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:10:06.201764 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-5a343b7c-e29d-4198-bd4a-a44cff868fe4 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:10:06.202648 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-5a343b7c-e29d-4198-bd4a-a44cff868fe4 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:10:06.202986 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-5a343b7c-e29d-4198-bd4a-a44cff868fe4 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:10:06.297056 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [req-e45fd9d5-4dee-4498-b638-b766568f0faa req-bccd2a4f-d8b6-40d8-8f33-02e97c9aa674 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1daf6093-9730-4221-9de3-11fa5735675f", "tag": "c7127a13-25e4-4848-94bc-e63def0cae14"}]} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:10:06.315253 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-e45fd9d5-4dee-4498-b638-b766568f0faa req-bccd2a4f-d8b6-40d8-8f33-02e97c9aa674 service nova] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:10:06.316105 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-e45fd9d5-4dee-4498-b638-b766568f0faa req-bccd2a4f-d8b6-40d8-8f33-02e97c9aa674 service nova] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:10:06.329714 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.compute.server_external_events [req-e45fd9d5-4dee-4498-b638-b766568f0faa req-bccd2a4f-d8b6-40d8-8f33-02e97c9aa674 service nova] Creating event network-changed:c7127a13-25e4-4848-94bc-e63def0cae14 for instance 1daf6093-9730-4221-9de3-11fa5735675f on hv-cinder-76810 Jun 29 08:10:06.335126 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [req-e45fd9d5-4dee-4498-b638-b766568f0faa req-bccd2a4f-d8b6-40d8-8f33-02e97c9aa674 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046782 Jun 29 08:10:06.335742 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 407/804] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jun 29 08:10:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:10:06.342220 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-911e7e4e-a57a-445b-9e95-a41dd8c2c838 tempest-VolumesActionsTest-246618099 tempest-VolumesActionsTest-246618099-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:10:06.343672 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-911e7e4e-a57a-445b-9e95-a41dd8c2c838 tempest-VolumesActionsTest-246618099 tempest-VolumesActionsTest-246618099-project] [instance: 1daf6093-9730-4221-9de3-11fa5735675f] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:10:06.346644 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-5a343b7c-e29d-4198-bd4a-a44cff868fe4 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4873db0f2fbf4a77a617f2102a5ccfae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4df15f6a6dd45dab12d0b724076a23e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:10:06.350297 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-911e7e4e-a57a-445b-9e95-a41dd8c2c838 tempest-VolumesActionsTest-246618099 tempest-VolumesActionsTest-246618099-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:10:06.350757 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-911e7e4e-a57a-445b-9e95-a41dd8c2c838 tempest-VolumesActionsTest-246618099 tempest-VolumesActionsTest-246618099-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:10:06.351001 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG dbcounter [-] [117890] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:10:06.351536 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-911e7e4e-a57a-445b-9e95-a41dd8c2c838 tempest-VolumesActionsTest-246618099 tempest-VolumesActionsTest-246618099-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:10:06.352086 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-911e7e4e-a57a-445b-9e95-a41dd8c2c838 tempest-VolumesActionsTest-246618099 tempest-VolumesActionsTest-246618099-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:10:06.356458 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-5a343b7c-e29d-4198-bd4a-a44cff868fe4 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] 10.222.0.43 "GET /compute/v2.1/servers/7c7721f2-e567-4e6f-aefd-d852fa3fe37a" status: 200 len: 1368 microversion: 2.1 time: 0.166307 Jun 29 08:10:06.357611 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 398/805] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:10:06 2022] GET /compute/v2.1/servers/7c7721f2-e567-4e6f-aefd-d852fa3fe37a => generated 1368 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:10:06.562596 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-911e7e4e-a57a-445b-9e95-a41dd8c2c838 tempest-VolumesActionsTest-246618099 tempest-VolumesActionsTest-246618099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b887b672801d436a80fde4c5b2f8ad61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '941e14f704b74aa7afe5ef3a75a3f24b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:10:06.569993 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-911e7e4e-a57a-445b-9e95-a41dd8c2c838 tempest-VolumesActionsTest-246618099 tempest-VolumesActionsTest-246618099-project] 10.222.0.43 "GET /compute/v2.1/servers/1daf6093-9730-4221-9de3-11fa5735675f" status: 200 len: 1314 microversion: 2.1 time: 0.233082 Jun 29 08:10:06.570574 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 408/806] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:10:06 2022] GET /compute/v2.1/servers/1daf6093-9730-4221-9de3-11fa5735675f => generated 1314 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:10:07.376023 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-685d2300-197b-4cd6-bbb8-0d18f75ac6dc tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:10:07.377310 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-685d2300-197b-4cd6-bbb8-0d18f75ac6dc tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] [instance: 7c7721f2-e567-4e6f-aefd-d852fa3fe37a] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:10:07.384540 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-685d2300-197b-4cd6-bbb8-0d18f75ac6dc tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:10:07.385003 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-685d2300-197b-4cd6-bbb8-0d18f75ac6dc tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:10:07.385812 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-685d2300-197b-4cd6-bbb8-0d18f75ac6dc tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:10:07.386248 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-685d2300-197b-4cd6-bbb8-0d18f75ac6dc tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:10:07.417848 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [req-cc08b59f-738d-42cd-9540-5924bd747f18 req-b539c521-b8ce-45f2-a4e3-d7ca8caf6e8e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c7721f2-e567-4e6f-aefd-d852fa3fe37a", "name": "network-vif-plugged", "status": "completed", "tag": "4d314f56-e850-4f57-8290-c2635e548696"}]} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:10:07.427596 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-cc08b59f-738d-42cd-9540-5924bd747f18 req-b539c521-b8ce-45f2-a4e3-d7ca8caf6e8e service nova] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:10:07.428065 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-cc08b59f-738d-42cd-9540-5924bd747f18 req-b539c521-b8ce-45f2-a4e3-d7ca8caf6e8e service nova] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:10:07.440744 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.compute.server_external_events [req-cc08b59f-738d-42cd-9540-5924bd747f18 req-b539c521-b8ce-45f2-a4e3-d7ca8caf6e8e service nova] Creating event network-vif-plugged:4d314f56-e850-4f57-8290-c2635e548696 for instance 7c7721f2-e567-4e6f-aefd-d852fa3fe37a on hv-cinder-76810 Jun 29 08:10:07.445675 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [req-cc08b59f-738d-42cd-9540-5924bd747f18 req-b539c521-b8ce-45f2-a4e3-d7ca8caf6e8e service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031596 Jun 29 08:10:07.446276 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 409/807] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jun 29 08:10:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 29 08:10:07.528619 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-685d2300-197b-4cd6-bbb8-0d18f75ac6dc tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4873db0f2fbf4a77a617f2102a5ccfae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4df15f6a6dd45dab12d0b724076a23e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:10:07.537545 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-685d2300-197b-4cd6-bbb8-0d18f75ac6dc tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] 10.222.0.43 "GET /compute/v2.1/servers/7c7721f2-e567-4e6f-aefd-d852fa3fe37a" status: 200 len: 1368 microversion: 2.1 time: 0.168119 Jun 29 08:10:07.538126 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 399/808] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:10:07 2022] GET /compute/v2.1/servers/7c7721f2-e567-4e6f-aefd-d852fa3fe37a => generated 1368 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:10:07.588171 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-b1ab7907-8842-4161-8f09-a1759bd38c05 tempest-VolumesActionsTest-246618099 tempest-VolumesActionsTest-246618099-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:10:07.588857 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-b1ab7907-8842-4161-8f09-a1759bd38c05 tempest-VolumesActionsTest-246618099 tempest-VolumesActionsTest-246618099-project] [instance: 1daf6093-9730-4221-9de3-11fa5735675f] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:10:07.596000 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-b1ab7907-8842-4161-8f09-a1759bd38c05 tempest-VolumesActionsTest-246618099 tempest-VolumesActionsTest-246618099-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:10:07.596446 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-b1ab7907-8842-4161-8f09-a1759bd38c05 tempest-VolumesActionsTest-246618099 tempest-VolumesActionsTest-246618099-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:10:07.597339 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-b1ab7907-8842-4161-8f09-a1759bd38c05 tempest-VolumesActionsTest-246618099 tempest-VolumesActionsTest-246618099-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:10:07.597774 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-b1ab7907-8842-4161-8f09-a1759bd38c05 tempest-VolumesActionsTest-246618099 tempest-VolumesActionsTest-246618099-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:10:07.728741 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-b1ab7907-8842-4161-8f09-a1759bd38c05 tempest-VolumesActionsTest-246618099 tempest-VolumesActionsTest-246618099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b887b672801d436a80fde4c5b2f8ad61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '941e14f704b74aa7afe5ef3a75a3f24b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:10:07.736238 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-b1ab7907-8842-4161-8f09-a1759bd38c05 tempest-VolumesActionsTest-246618099 tempest-VolumesActionsTest-246618099-project] 10.222.0.43 "GET /compute/v2.1/servers/1daf6093-9730-4221-9de3-11fa5735675f" status: 200 len: 1314 microversion: 2.1 time: 0.152270 Jun 29 08:10:07.736807 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 410/809] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:10:07 2022] GET /compute/v2.1/servers/1daf6093-9730-4221-9de3-11fa5735675f => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:10:08.553764 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-2cd211f4-a76a-4b73-9303-57600adc1eb7 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:10:08.554378 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-2cd211f4-a76a-4b73-9303-57600adc1eb7 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] [instance: 7c7721f2-e567-4e6f-aefd-d852fa3fe37a] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:10:08.560907 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-2cd211f4-a76a-4b73-9303-57600adc1eb7 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:10:08.561386 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-2cd211f4-a76a-4b73-9303-57600adc1eb7 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:10:08.562138 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-2cd211f4-a76a-4b73-9303-57600adc1eb7 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:10:08.562571 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-2cd211f4-a76a-4b73-9303-57600adc1eb7 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:10:08.695630 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-2cd211f4-a76a-4b73-9303-57600adc1eb7 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4873db0f2fbf4a77a617f2102a5ccfae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4df15f6a6dd45dab12d0b724076a23e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:10:08.703519 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-2cd211f4-a76a-4b73-9303-57600adc1eb7 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] 10.222.0.43 "GET /compute/v2.1/servers/7c7721f2-e567-4e6f-aefd-d852fa3fe37a" status: 200 len: 1368 microversion: 2.1 time: 0.153869 Jun 29 08:10:08.704080 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 400/810] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:10:08 2022] GET /compute/v2.1/servers/7c7721f2-e567-4e6f-aefd-d852fa3fe37a => generated 1368 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:10:08.752720 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-e082acdc-28c5-4db7-a2e5-76f91f2ff7c6 tempest-VolumesActionsTest-246618099 tempest-VolumesActionsTest-246618099-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:10:08.753401 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-e082acdc-28c5-4db7-a2e5-76f91f2ff7c6 tempest-VolumesActionsTest-246618099 tempest-VolumesActionsTest-246618099-project] [instance: 1daf6093-9730-4221-9de3-11fa5735675f] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:10:08.759927 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e082acdc-28c5-4db7-a2e5-76f91f2ff7c6 tempest-VolumesActionsTest-246618099 tempest-VolumesActionsTest-246618099-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:10:08.760375 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e082acdc-28c5-4db7-a2e5-76f91f2ff7c6 tempest-VolumesActionsTest-246618099 tempest-VolumesActionsTest-246618099-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:10:08.761182 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e082acdc-28c5-4db7-a2e5-76f91f2ff7c6 tempest-VolumesActionsTest-246618099 tempest-VolumesActionsTest-246618099-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:10:08.761623 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e082acdc-28c5-4db7-a2e5-76f91f2ff7c6 tempest-VolumesActionsTest-246618099 tempest-VolumesActionsTest-246618099-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:10:08.956768 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-e082acdc-28c5-4db7-a2e5-76f91f2ff7c6 tempest-VolumesActionsTest-246618099 tempest-VolumesActionsTest-246618099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b887b672801d436a80fde4c5b2f8ad61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '941e14f704b74aa7afe5ef3a75a3f24b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:10:08.964375 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-e082acdc-28c5-4db7-a2e5-76f91f2ff7c6 tempest-VolumesActionsTest-246618099 tempest-VolumesActionsTest-246618099-project] 10.222.0.43 "GET /compute/v2.1/servers/1daf6093-9730-4221-9de3-11fa5735675f" status: 200 len: 1314 microversion: 2.1 time: 0.215680 Jun 29 08:10:08.964955 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 411/811] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:10:08 2022] GET /compute/v2.1/servers/1daf6093-9730-4221-9de3-11fa5735675f => generated 1314 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:10:09.721135 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-ac5a4ab8-d61c-4126-905f-230fd117fc87 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:10:09.721940 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-ac5a4ab8-d61c-4126-905f-230fd117fc87 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] [instance: 7c7721f2-e567-4e6f-aefd-d852fa3fe37a] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:10:09.729416 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-ac5a4ab8-d61c-4126-905f-230fd117fc87 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:10:09.729862 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-ac5a4ab8-d61c-4126-905f-230fd117fc87 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:10:09.732197 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-ac5a4ab8-d61c-4126-905f-230fd117fc87 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:10:09.732197 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-ac5a4ab8-d61c-4126-905f-230fd117fc87 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:10:09.872136 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-ac5a4ab8-d61c-4126-905f-230fd117fc87 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4873db0f2fbf4a77a617f2102a5ccfae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4df15f6a6dd45dab12d0b724076a23e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:10:09.879826 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-ac5a4ab8-d61c-4126-905f-230fd117fc87 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] 10.222.0.43 "GET /compute/v2.1/servers/7c7721f2-e567-4e6f-aefd-d852fa3fe37a" status: 200 len: 1368 microversion: 2.1 time: 0.163085 Jun 29 08:10:09.880409 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 401/812] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:10:09 2022] GET /compute/v2.1/servers/7c7721f2-e567-4e6f-aefd-d852fa3fe37a => generated 1368 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:10:09.982647 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-ab7308b3-cdde-4c2f-afa2-90b0634c935d tempest-VolumesActionsTest-246618099 tempest-VolumesActionsTest-246618099-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:10:09.983168 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-ab7308b3-cdde-4c2f-afa2-90b0634c935d tempest-VolumesActionsTest-246618099 tempest-VolumesActionsTest-246618099-project] [instance: 1daf6093-9730-4221-9de3-11fa5735675f] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:10:09.989688 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ab7308b3-cdde-4c2f-afa2-90b0634c935d tempest-VolumesActionsTest-246618099 tempest-VolumesActionsTest-246618099-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:10:09.990134 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ab7308b3-cdde-4c2f-afa2-90b0634c935d tempest-VolumesActionsTest-246618099 tempest-VolumesActionsTest-246618099-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:10:09.990889 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ab7308b3-cdde-4c2f-afa2-90b0634c935d tempest-VolumesActionsTest-246618099 tempest-VolumesActionsTest-246618099-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:10:09.991319 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ab7308b3-cdde-4c2f-afa2-90b0634c935d tempest-VolumesActionsTest-246618099 tempest-VolumesActionsTest-246618099-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:10:10.131663 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-ab7308b3-cdde-4c2f-afa2-90b0634c935d tempest-VolumesActionsTest-246618099 tempest-VolumesActionsTest-246618099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b887b672801d436a80fde4c5b2f8ad61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '941e14f704b74aa7afe5ef3a75a3f24b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:10:10.140162 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-ab7308b3-cdde-4c2f-afa2-90b0634c935d tempest-VolumesActionsTest-246618099 tempest-VolumesActionsTest-246618099-project] 10.222.0.43 "GET /compute/v2.1/servers/1daf6093-9730-4221-9de3-11fa5735675f" status: 200 len: 1314 microversion: 2.1 time: 0.161923 Jun 29 08:10:10.141233 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 412/813] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:10:09 2022] GET /compute/v2.1/servers/1daf6093-9730-4221-9de3-11fa5735675f => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:10:10.896469 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-2746bd09-15c1-4109-8e3e-fb81a7f7fc9b tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:10:10.897113 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-2746bd09-15c1-4109-8e3e-fb81a7f7fc9b tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] [instance: 7c7721f2-e567-4e6f-aefd-d852fa3fe37a] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:10:10.898936 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG dbcounter [-] [117890] Writing DB stats nova_cell0:SELECT=2 {{(pid=117890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:10:10.904755 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-2746bd09-15c1-4109-8e3e-fb81a7f7fc9b tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:10:10.905237 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-2746bd09-15c1-4109-8e3e-fb81a7f7fc9b tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:10:10.906001 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-2746bd09-15c1-4109-8e3e-fb81a7f7fc9b tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:10:10.906438 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-2746bd09-15c1-4109-8e3e-fb81a7f7fc9b tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:10:11.037326 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-2746bd09-15c1-4109-8e3e-fb81a7f7fc9b tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4873db0f2fbf4a77a617f2102a5ccfae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4df15f6a6dd45dab12d0b724076a23e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:10:11.046469 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-2746bd09-15c1-4109-8e3e-fb81a7f7fc9b tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] 10.222.0.43 "GET /compute/v2.1/servers/7c7721f2-e567-4e6f-aefd-d852fa3fe37a" status: 200 len: 1558 microversion: 2.1 time: 0.153910 Jun 29 08:10:11.047276 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 402/814] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:10:10 2022] GET /compute/v2.1/servers/7c7721f2-e567-4e6f-aefd-d852fa3fe37a => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:10:11.063370 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-425f815c-8511-411b-8b35-0d9838148eb6 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:10:11.063868 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-425f815c-8511-411b-8b35-0d9838148eb6 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] [instance: 7c7721f2-e567-4e6f-aefd-d852fa3fe37a] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:10:11.070262 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-425f815c-8511-411b-8b35-0d9838148eb6 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:10:11.070701 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-425f815c-8511-411b-8b35-0d9838148eb6 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:10:11.072404 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-425f815c-8511-411b-8b35-0d9838148eb6 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:10:11.072404 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-425f815c-8511-411b-8b35-0d9838148eb6 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:10:11.147865 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-425f815c-8511-411b-8b35-0d9838148eb6 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] 10.222.0.43 "GET /compute/v2.1/servers/7c7721f2-e567-4e6f-aefd-d852fa3fe37a/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.088884 Jun 29 08:10:11.148463 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 413/815] 10.222.0.43 () {58 vars in 1274 bytes} [Wed Jun 29 08:10:11 2022] GET /compute/v2.1/servers/7c7721f2-e567-4e6f-aefd-d852fa3fe37a/os-interface => generated 285 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:10:11.157640 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-902ab945-860a-4b3e-b3f1-c93725476924 tempest-VolumesActionsTest-246618099 tempest-VolumesActionsTest-246618099-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:10:11.158405 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-902ab945-860a-4b3e-b3f1-c93725476924 tempest-VolumesActionsTest-246618099 tempest-VolumesActionsTest-246618099-project] [instance: 1daf6093-9730-4221-9de3-11fa5735675f] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:10:11.164951 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-902ab945-860a-4b3e-b3f1-c93725476924 tempest-VolumesActionsTest-246618099 tempest-VolumesActionsTest-246618099-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:10:11.165433 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-902ab945-860a-4b3e-b3f1-c93725476924 tempest-VolumesActionsTest-246618099 tempest-VolumesActionsTest-246618099-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:10:11.166196 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-902ab945-860a-4b3e-b3f1-c93725476924 tempest-VolumesActionsTest-246618099 tempest-VolumesActionsTest-246618099-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:10:11.166626 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-902ab945-860a-4b3e-b3f1-c93725476924 tempest-VolumesActionsTest-246618099 tempest-VolumesActionsTest-246618099-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:10:11.316265 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-902ab945-860a-4b3e-b3f1-c93725476924 tempest-VolumesActionsTest-246618099 tempest-VolumesActionsTest-246618099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b887b672801d436a80fde4c5b2f8ad61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '941e14f704b74aa7afe5ef3a75a3f24b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:10:11.324252 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-902ab945-860a-4b3e-b3f1-c93725476924 tempest-VolumesActionsTest-246618099 tempest-VolumesActionsTest-246618099-project] 10.222.0.43 "GET /compute/v2.1/servers/1daf6093-9730-4221-9de3-11fa5735675f" status: 200 len: 1314 microversion: 2.1 time: 0.170824 Jun 29 08:10:11.324841 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 403/816] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:10:11 2022] GET /compute/v2.1/servers/1daf6093-9730-4221-9de3-11fa5735675f => generated 1314 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:10:11.439791 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [req-ca4c046c-f92c-41de-a4e5-6408d5fd0d56 req-f1a7304a-fa5b-4781-a7df-89e58ea067d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1daf6093-9730-4221-9de3-11fa5735675f", "name": "network-vif-plugged", "status": "completed", "tag": "c7127a13-25e4-4848-94bc-e63def0cae14"}]} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:10:11.449951 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-ca4c046c-f92c-41de-a4e5-6408d5fd0d56 req-f1a7304a-fa5b-4781-a7df-89e58ea067d4 service nova] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:10:11.450616 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-ca4c046c-f92c-41de-a4e5-6408d5fd0d56 req-f1a7304a-fa5b-4781-a7df-89e58ea067d4 service nova] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:10:11.467016 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.compute.server_external_events [req-ca4c046c-f92c-41de-a4e5-6408d5fd0d56 req-f1a7304a-fa5b-4781-a7df-89e58ea067d4 service nova] Creating event network-vif-plugged:c7127a13-25e4-4848-94bc-e63def0cae14 for instance 1daf6093-9730-4221-9de3-11fa5735675f on hv-cinder-76810 Jun 29 08:10:11.478889 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [req-ca4c046c-f92c-41de-a4e5-6408d5fd0d56 req-f1a7304a-fa5b-4781-a7df-89e58ea067d4 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044497 Jun 29 08:10:11.479549 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 414/817] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jun 29 08:10:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:10:12.341740 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-82e85c57-ff48-4055-8ff7-c8766287d505 tempest-VolumesActionsTest-246618099 tempest-VolumesActionsTest-246618099-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:10:12.342498 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-82e85c57-ff48-4055-8ff7-c8766287d505 tempest-VolumesActionsTest-246618099 tempest-VolumesActionsTest-246618099-project] [instance: 1daf6093-9730-4221-9de3-11fa5735675f] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:10:12.349267 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-82e85c57-ff48-4055-8ff7-c8766287d505 tempest-VolumesActionsTest-246618099 tempest-VolumesActionsTest-246618099-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:10:12.349720 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-82e85c57-ff48-4055-8ff7-c8766287d505 tempest-VolumesActionsTest-246618099 tempest-VolumesActionsTest-246618099-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:10:12.350501 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-82e85c57-ff48-4055-8ff7-c8766287d505 tempest-VolumesActionsTest-246618099 tempest-VolumesActionsTest-246618099-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:10:12.350919 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-82e85c57-ff48-4055-8ff7-c8766287d505 tempest-VolumesActionsTest-246618099 tempest-VolumesActionsTest-246618099-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:10:12.512434 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [req-1b665a43-8296-4a4b-994b-357eb8becc72 req-a7301083-69aa-4600-8cf0-b1f51d87d8fc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c7721f2-e567-4e6f-aefd-d852fa3fe37a", "tag": "4d314f56-e850-4f57-8290-c2635e548696"}]} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:10:12.513953 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-82e85c57-ff48-4055-8ff7-c8766287d505 tempest-VolumesActionsTest-246618099 tempest-VolumesActionsTest-246618099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b887b672801d436a80fde4c5b2f8ad61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '941e14f704b74aa7afe5ef3a75a3f24b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:10:12.521659 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-82e85c57-ff48-4055-8ff7-c8766287d505 tempest-VolumesActionsTest-246618099 tempest-VolumesActionsTest-246618099-project] 10.222.0.43 "GET /compute/v2.1/servers/1daf6093-9730-4221-9de3-11fa5735675f" status: 200 len: 1314 microversion: 2.1 time: 0.183999 Jun 29 08:10:12.522491 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 404/818] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:10:12 2022] GET /compute/v2.1/servers/1daf6093-9730-4221-9de3-11fa5735675f => generated 1314 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:10:12.524016 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-1b665a43-8296-4a4b-994b-357eb8becc72 req-a7301083-69aa-4600-8cf0-b1f51d87d8fc service nova] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:10:12.524468 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-1b665a43-8296-4a4b-994b-357eb8becc72 req-a7301083-69aa-4600-8cf0-b1f51d87d8fc service nova] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:10:12.536246 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.compute.server_external_events [req-1b665a43-8296-4a4b-994b-357eb8becc72 req-a7301083-69aa-4600-8cf0-b1f51d87d8fc service nova] Creating event network-changed:4d314f56-e850-4f57-8290-c2635e548696 for instance 7c7721f2-e567-4e6f-aefd-d852fa3fe37a on hv-cinder-76810 Jun 29 08:10:12.541190 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [req-1b665a43-8296-4a4b-994b-357eb8becc72 req-a7301083-69aa-4600-8cf0-b1f51d87d8fc service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033340 Jun 29 08:10:12.541796 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 415/819] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jun 29 08:10:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 29 08:10:13.542171 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-b8d83f21-c8a0-4134-a87a-5558f5b54d39 tempest-VolumesActionsTest-246618099 tempest-VolumesActionsTest-246618099-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:10:13.543418 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-b8d83f21-c8a0-4134-a87a-5558f5b54d39 tempest-VolumesActionsTest-246618099 tempest-VolumesActionsTest-246618099-project] [instance: 1daf6093-9730-4221-9de3-11fa5735675f] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:10:13.548309 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG dbcounter [-] [117890] Writing DB stats nova_cell0:SELECT=8 {{(pid=117890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:10:13.555456 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-b8d83f21-c8a0-4134-a87a-5558f5b54d39 tempest-VolumesActionsTest-246618099 tempest-VolumesActionsTest-246618099-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:10:13.556669 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-b8d83f21-c8a0-4134-a87a-5558f5b54d39 tempest-VolumesActionsTest-246618099 tempest-VolumesActionsTest-246618099-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:10:13.558384 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-b8d83f21-c8a0-4134-a87a-5558f5b54d39 tempest-VolumesActionsTest-246618099 tempest-VolumesActionsTest-246618099-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:10:13.559451 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-b8d83f21-c8a0-4134-a87a-5558f5b54d39 tempest-VolumesActionsTest-246618099 tempest-VolumesActionsTest-246618099-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:10:13.724141 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-b8d83f21-c8a0-4134-a87a-5558f5b54d39 tempest-VolumesActionsTest-246618099 tempest-VolumesActionsTest-246618099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b887b672801d436a80fde4c5b2f8ad61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '941e14f704b74aa7afe5ef3a75a3f24b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:10:13.731690 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-b8d83f21-c8a0-4134-a87a-5558f5b54d39 tempest-VolumesActionsTest-246618099 tempest-VolumesActionsTest-246618099-project] 10.222.0.43 "GET /compute/v2.1/servers/1daf6093-9730-4221-9de3-11fa5735675f" status: 200 len: 1314 microversion: 2.1 time: 0.196650 Jun 29 08:10:13.732815 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 405/820] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:10:13 2022] GET /compute/v2.1/servers/1daf6093-9730-4221-9de3-11fa5735675f => generated 1314 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:10:14.746365 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_cell0:SELECT=2 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:10:14.747067 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_cell0:SELECT=12 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:10:14.751736 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-cb073a22-20e2-485f-884f-c43ce87ef211 tempest-VolumesActionsTest-246618099 tempest-VolumesActionsTest-246618099-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:10:14.752510 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-cb073a22-20e2-485f-884f-c43ce87ef211 tempest-VolumesActionsTest-246618099 tempest-VolumesActionsTest-246618099-project] [instance: 1daf6093-9730-4221-9de3-11fa5735675f] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:10:14.759789 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-cb073a22-20e2-485f-884f-c43ce87ef211 tempest-VolumesActionsTest-246618099 tempest-VolumesActionsTest-246618099-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:10:14.760241 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-cb073a22-20e2-485f-884f-c43ce87ef211 tempest-VolumesActionsTest-246618099 tempest-VolumesActionsTest-246618099-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:10:14.761040 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-cb073a22-20e2-485f-884f-c43ce87ef211 tempest-VolumesActionsTest-246618099 tempest-VolumesActionsTest-246618099-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:10:14.761508 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-cb073a22-20e2-485f-884f-c43ce87ef211 tempest-VolumesActionsTest-246618099 tempest-VolumesActionsTest-246618099-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:10:14.898750 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-cb073a22-20e2-485f-884f-c43ce87ef211 tempest-VolumesActionsTest-246618099 tempest-VolumesActionsTest-246618099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b887b672801d436a80fde4c5b2f8ad61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '941e14f704b74aa7afe5ef3a75a3f24b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:10:14.906966 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-cb073a22-20e2-485f-884f-c43ce87ef211 tempest-VolumesActionsTest-246618099 tempest-VolumesActionsTest-246618099-project] 10.222.0.43 "GET /compute/v2.1/servers/1daf6093-9730-4221-9de3-11fa5735675f" status: 200 len: 1498 microversion: 2.1 time: 0.161666 Jun 29 08:10:14.907539 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 416/821] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:10:14 2022] GET /compute/v2.1/servers/1daf6093-9730-4221-9de3-11fa5735675f => generated 1498 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:10:15.419731 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-466a4d46-ee50-468d-afc2-c2805b70c9ee tempest-VolumesActionsTest-246618099 tempest-VolumesActionsTest-246618099-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:10:15.420244 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-466a4d46-ee50-468d-afc2-c2805b70c9ee tempest-VolumesActionsTest-246618099 tempest-VolumesActionsTest-246618099-project] [instance: 1daf6093-9730-4221-9de3-11fa5735675f] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:10:15.426939 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-466a4d46-ee50-468d-afc2-c2805b70c9ee tempest-VolumesActionsTest-246618099 tempest-VolumesActionsTest-246618099-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:10:15.427377 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-466a4d46-ee50-468d-afc2-c2805b70c9ee tempest-VolumesActionsTest-246618099 tempest-VolumesActionsTest-246618099-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:10:15.428135 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-466a4d46-ee50-468d-afc2-c2805b70c9ee tempest-VolumesActionsTest-246618099 tempest-VolumesActionsTest-246618099-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:10:15.428566 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-466a4d46-ee50-468d-afc2-c2805b70c9ee tempest-VolumesActionsTest-246618099 tempest-VolumesActionsTest-246618099-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:10:15.455762 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-466a4d46-ee50-468d-afc2-c2805b70c9ee tempest-VolumesActionsTest-246618099 tempest-VolumesActionsTest-246618099-project] [instance: 1daf6093-9730-4221-9de3-11fa5735675f] Going to try to terminate instance {{(pid=117890) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 29 08:10:15.531420 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-466a4d46-ee50-468d-afc2-c2805b70c9ee tempest-VolumesActionsTest-246618099 tempest-VolumesActionsTest-246618099-project] 10.222.0.43 "DELETE /compute/v2.1/servers/1daf6093-9730-4221-9de3-11fa5735675f" status: 204 len: 0 microversion: 2.1 time: 0.115564 Jun 29 08:10:15.531956 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 406/822] 10.222.0.43 () {58 vars in 1238 bytes} [Wed Jun 29 08:10:15 2022] DELETE /compute/v2.1/servers/1daf6093-9730-4221-9de3-11fa5735675f => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 29 08:10:15.540264 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-d60b148f-80c7-405a-bdb1-f7642b0c1055 tempest-VolumesActionsTest-246618099 tempest-VolumesActionsTest-246618099-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:10:15.540918 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-d60b148f-80c7-405a-bdb1-f7642b0c1055 tempest-VolumesActionsTest-246618099 tempest-VolumesActionsTest-246618099-project] [instance: 1daf6093-9730-4221-9de3-11fa5735675f] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:10:15.547696 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-d60b148f-80c7-405a-bdb1-f7642b0c1055 tempest-VolumesActionsTest-246618099 tempest-VolumesActionsTest-246618099-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:10:15.548140 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-d60b148f-80c7-405a-bdb1-f7642b0c1055 tempest-VolumesActionsTest-246618099 tempest-VolumesActionsTest-246618099-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:10:15.548901 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-d60b148f-80c7-405a-bdb1-f7642b0c1055 tempest-VolumesActionsTest-246618099 tempest-VolumesActionsTest-246618099-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:10:15.549441 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-d60b148f-80c7-405a-bdb1-f7642b0c1055 tempest-VolumesActionsTest-246618099 tempest-VolumesActionsTest-246618099-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:10:15.692781 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-d60b148f-80c7-405a-bdb1-f7642b0c1055 tempest-VolumesActionsTest-246618099 tempest-VolumesActionsTest-246618099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b887b672801d436a80fde4c5b2f8ad61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '941e14f704b74aa7afe5ef3a75a3f24b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:10:15.700386 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-d60b148f-80c7-405a-bdb1-f7642b0c1055 tempest-VolumesActionsTest-246618099 tempest-VolumesActionsTest-246618099-project] 10.222.0.43 "GET /compute/v2.1/servers/1daf6093-9730-4221-9de3-11fa5735675f" status: 200 len: 1504 microversion: 2.1 time: 0.163969 Jun 29 08:10:15.701620 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 417/823] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:10:15 2022] GET /compute/v2.1/servers/1daf6093-9730-4221-9de3-11fa5735675f => generated 1504 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:10:16.719290 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-d1c529c3-8c09-4a0e-85fd-f8e30e4c259f tempest-VolumesActionsTest-246618099 tempest-VolumesActionsTest-246618099-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:10:16.719908 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-d1c529c3-8c09-4a0e-85fd-f8e30e4c259f tempest-VolumesActionsTest-246618099 tempest-VolumesActionsTest-246618099-project] [instance: 1daf6093-9730-4221-9de3-11fa5735675f] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:10:16.726547 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-d1c529c3-8c09-4a0e-85fd-f8e30e4c259f tempest-VolumesActionsTest-246618099 tempest-VolumesActionsTest-246618099-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:10:16.727002 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-d1c529c3-8c09-4a0e-85fd-f8e30e4c259f tempest-VolumesActionsTest-246618099 tempest-VolumesActionsTest-246618099-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:10:16.727775 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-d1c529c3-8c09-4a0e-85fd-f8e30e4c259f tempest-VolumesActionsTest-246618099 tempest-VolumesActionsTest-246618099-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:10:16.728210 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-d1c529c3-8c09-4a0e-85fd-f8e30e4c259f tempest-VolumesActionsTest-246618099 tempest-VolumesActionsTest-246618099-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:10:16.868958 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-d1c529c3-8c09-4a0e-85fd-f8e30e4c259f tempest-VolumesActionsTest-246618099 tempest-VolumesActionsTest-246618099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b887b672801d436a80fde4c5b2f8ad61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '941e14f704b74aa7afe5ef3a75a3f24b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:10:16.877233 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-d1c529c3-8c09-4a0e-85fd-f8e30e4c259f tempest-VolumesActionsTest-246618099 tempest-VolumesActionsTest-246618099-project] 10.222.0.43 "GET /compute/v2.1/servers/1daf6093-9730-4221-9de3-11fa5735675f" status: 200 len: 1504 microversion: 2.1 time: 0.162573 Jun 29 08:10:16.877812 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 407/824] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:10:16 2022] GET /compute/v2.1/servers/1daf6093-9730-4221-9de3-11fa5735675f => generated 1504 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:10:17.743108 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [req-8d1d36a8-5708-4e68-a215-23b3d71e462b req-0059a172-49aa-4f30-8029-0ad90ef8d7a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1daf6093-9730-4221-9de3-11fa5735675f", "name": "network-vif-deleted", "tag": "c7127a13-25e4-4848-94bc-e63def0cae14"}]} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:10:17.753760 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-8d1d36a8-5708-4e68-a215-23b3d71e462b req-0059a172-49aa-4f30-8029-0ad90ef8d7a0 service nova] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:10:17.754210 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-8d1d36a8-5708-4e68-a215-23b3d71e462b req-0059a172-49aa-4f30-8029-0ad90ef8d7a0 service nova] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:10:17.766803 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.compute.server_external_events [req-8d1d36a8-5708-4e68-a215-23b3d71e462b req-0059a172-49aa-4f30-8029-0ad90ef8d7a0 service nova] Creating event network-vif-deleted:c7127a13-25e4-4848-94bc-e63def0cae14 for instance 1daf6093-9730-4221-9de3-11fa5735675f on hv-cinder-76810 Jun 29 08:10:17.772102 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [req-8d1d36a8-5708-4e68-a215-23b3d71e462b req-0059a172-49aa-4f30-8029-0ad90ef8d7a0 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032634 Jun 29 08:10:17.773086 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 418/825] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jun 29 08:10:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:10:17.895736 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-6d081005-bb6d-4a2f-8b01-def836b9f884 tempest-VolumesActionsTest-246618099 tempest-VolumesActionsTest-246618099-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:10:17.896592 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-6d081005-bb6d-4a2f-8b01-def836b9f884 tempest-VolumesActionsTest-246618099 tempest-VolumesActionsTest-246618099-project] [instance: 1daf6093-9730-4221-9de3-11fa5735675f] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:10:17.903102 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-6d081005-bb6d-4a2f-8b01-def836b9f884 tempest-VolumesActionsTest-246618099 tempest-VolumesActionsTest-246618099-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:10:17.903549 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-6d081005-bb6d-4a2f-8b01-def836b9f884 tempest-VolumesActionsTest-246618099 tempest-VolumesActionsTest-246618099-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:10:17.904882 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-6d081005-bb6d-4a2f-8b01-def836b9f884 tempest-VolumesActionsTest-246618099 tempest-VolumesActionsTest-246618099-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:10:17.905344 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-6d081005-bb6d-4a2f-8b01-def836b9f884 tempest-VolumesActionsTest-246618099 tempest-VolumesActionsTest-246618099-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:10:17.944273 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-6d081005-bb6d-4a2f-8b01-def836b9f884 tempest-VolumesActionsTest-246618099 tempest-VolumesActionsTest-246618099-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:10:17.944739 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-6d081005-bb6d-4a2f-8b01-def836b9f884 tempest-VolumesActionsTest-246618099 tempest-VolumesActionsTest-246618099-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:10:17.945237 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.objects.instance [None req-6d081005-bb6d-4a2f-8b01-def836b9f884 tempest-VolumesActionsTest-246618099 tempest-VolumesActionsTest-246618099-project] Lazy-loading 'fault' on Instance uuid 1daf6093-9730-4221-9de3-11fa5735675f {{(pid=117890) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 29 08:10:17.988288 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-6d081005-bb6d-4a2f-8b01-def836b9f884 tempest-VolumesActionsTest-246618099 tempest-VolumesActionsTest-246618099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b887b672801d436a80fde4c5b2f8ad61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '941e14f704b74aa7afe5ef3a75a3f24b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:10:17.996412 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-6d081005-bb6d-4a2f-8b01-def836b9f884 tempest-VolumesActionsTest-246618099 tempest-VolumesActionsTest-246618099-project] 10.222.0.43 "GET /compute/v2.1/servers/1daf6093-9730-4221-9de3-11fa5735675f" status: 200 len: 1304 microversion: 2.1 time: 0.104687 Jun 29 08:10:17.997003 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 408/826] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:10:17 2022] GET /compute/v2.1/servers/1daf6093-9730-4221-9de3-11fa5735675f => generated 1304 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:10:19.018517 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-70ac02fd-a602-49be-990b-7933a359747a tempest-VolumesActionsTest-246618099 tempest-VolumesActionsTest-246618099-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:10:19.019673 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-70ac02fd-a602-49be-990b-7933a359747a tempest-VolumesActionsTest-246618099 tempest-VolumesActionsTest-246618099-project] [instance: 1daf6093-9730-4221-9de3-11fa5735675f] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:10:19.027435 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-70ac02fd-a602-49be-990b-7933a359747a tempest-VolumesActionsTest-246618099 tempest-VolumesActionsTest-246618099-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:10:19.027888 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-70ac02fd-a602-49be-990b-7933a359747a tempest-VolumesActionsTest-246618099 tempest-VolumesActionsTest-246618099-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:10:19.028715 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-70ac02fd-a602-49be-990b-7933a359747a tempest-VolumesActionsTest-246618099 tempest-VolumesActionsTest-246618099-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:10:19.029464 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-70ac02fd-a602-49be-990b-7933a359747a tempest-VolumesActionsTest-246618099 tempest-VolumesActionsTest-246618099-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:10:19.042748 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.wsgi [None req-70ac02fd-a602-49be-990b-7933a359747a tempest-VolumesActionsTest-246618099 tempest-VolumesActionsTest-246618099-project] HTTP exception thrown: Instance 1daf6093-9730-4221-9de3-11fa5735675f could not be found. Jun 29 08:10:19.045467 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-70ac02fd-a602-49be-990b-7933a359747a tempest-VolumesActionsTest-246618099 tempest-VolumesActionsTest-246618099-project] Request method failure captured: Jun 29 08:10:19.045467 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: request: GET /compute/v2.1/servers/1daf6093-9730-4221-9de3-11fa5735675f HTTP/1.1 Jun 29 08:10:19.045467 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: Accept: application/json Jun 29 08:10:19.045467 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: Accept-Encoding: identity Jun 29 08:10:19.045467 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: Connection: close Jun 29 08:10:19.045467 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: Content-Length: 0 Jun 29 08:10:19.045467 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: Content-Type: application/json Jun 29 08:10:19.045467 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: Host: 10.222.0.43 Jun 29 08:10:19.045467 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: Openstack-System-Scope: None Jun 29 08:10:19.045467 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: User-Agent: python-urllib3/1.26.9 Jun 29 08:10:19.045467 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Auth-Token: gAAAAABivAjYnT07Uba9gQL8rE-MVyTnmVSAG9C1ImbvRlzEeip7L3_xSHjl_U2wmlzJDtnTNNZMTq6cW8F5nVv0Cw_xLlIQOss42OS4bL3yUcobdo3alijL-Nk_RUma09ciu6A0Xo6oUN1SbfmnD7maT8Q67c7pHesTMaxsbDZxB7IOmfAnZOI Jun 29 08:10:19.045467 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Domain-Id: None Jun 29 08:10:19.045467 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Domain-Name: None Jun 29 08:10:19.045467 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Identity-Status: Confirmed Jun 29 08:10:19.045467 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Is-Admin-Project: True Jun 29 08:10:19.045467 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Project-Domain-Id: default Jun 29 08:10:19.045467 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Project-Domain-Name: Default Jun 29 08:10:19.045467 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Project-Id: 941e14f704b74aa7afe5ef3a75a3f24b Jun 29 08:10:19.045467 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Project-Name: tempest-VolumesActionsTest-246618099 Jun 29 08:10:19.045467 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Role: member,reader Jun 29 08:10:19.045467 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Roles: member,reader Jun 29 08:10:19.047191 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/941e14f704b74aa7afe5ef3a75a3f24b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_941e14f704b74aa7afe5ef3a75a3f24b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/941e14f704b74aa7afe5ef3a75a3f24b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/941e14f704b74aa7afe5ef3a75a3f24b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Jun 29 08:10:19.047191 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Tenant: tempest-VolumesActionsTest-246618099 Jun 29 08:10:19.047191 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Tenant-Id: 941e14f704b74aa7afe5ef3a75a3f24b Jun 29 08:10:19.047191 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Tenant-Name: tempest-VolumesActionsTest-246618099 Jun 29 08:10:19.047191 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-User: tempest-VolumesActionsTest-246618099-project Jun 29 08:10:19.047191 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-User-Domain-Id: default Jun 29 08:10:19.047191 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-User-Domain-Name: Default Jun 29 08:10:19.047191 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-User-Id: b887b672801d436a80fde4c5b2f8ad61 Jun 29 08:10:19.047191 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-User-Name: tempest-VolumesActionsTest-246618099-project Jun 29 08:10:19.047191 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: method: > Jun 29 08:10:19.047191 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: exception: Instance 1daf6093-9730-4221-9de3-11fa5735675f could not be found. Jun 29 08:10:19.047191 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: action_args: {'id': '1daf6093-9730-4221-9de3-11fa5735675f'} Jun 29 08:10:19.048211 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 08:10:19.048211 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:10:19.048211 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 29 08:10:19.048211 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 29 08:10:19.048211 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 29 08:10:19.048211 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 29 08:10:19.048211 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 29 08:10:19.048211 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 29 08:10:19.048211 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 29 08:10:19.048211 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 29 08:10:19.048211 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1daf6093-9730-4221-9de3-11fa5735675f could not be found. Jun 29 08:10:19.048211 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 29 08:10:19.048211 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 08:10:19.048211 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 29 08:10:19.048211 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:10:19.048211 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 08:10:19.048211 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 08:10:19.048211 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 08:10:19.048211 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 08:10:19.048211 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 08:10:19.049888 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 08:10:19.049888 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 29 08:10:19.049888 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 29 08:10:19.049888 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 29 08:10:19.049888 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 29 08:10:19.049888 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 29 08:10:19.049888 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 29 08:10:19.049888 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1daf6093-9730-4221-9de3-11fa5735675f could not be found. Jun 29 08:10:19.049888 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 29 08:10:19.049888 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 08:10:19.049888 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 29 08:10:19.049888 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:10:19.049888 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 08:10:19.049888 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 08:10:19.049888 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 08:10:19.049888 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 08:10:19.049888 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1daf6093-9730-4221-9de3-11fa5735675f could not be found. Jun 29 08:10:19.049888 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 29 08:10:19.051529 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-70ac02fd-a602-49be-990b-7933a359747a tempest-VolumesActionsTest-246618099 tempest-VolumesActionsTest-246618099-project] Returning 404 to user: Instance 1daf6093-9730-4221-9de3-11fa5735675f could not be found. {{(pid=117889) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 08:10:19.051529 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-70ac02fd-a602-49be-990b-7933a359747a tempest-VolumesActionsTest-246618099 tempest-VolumesActionsTest-246618099-project] 10.222.0.43 "GET /compute/v2.1/servers/1daf6093-9730-4221-9de3-11fa5735675f" status: 404 len: 111 microversion: 2.1 time: 0.036391 Jun 29 08:10:19.051529 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 419/827] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:10:19 2022] GET /compute/v2.1/servers/1daf6093-9730-4221-9de3-11fa5735675f => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 29 08:10:19.100857 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-955694ca-9eea-404c-8206-999c5916a5a9 tempest-VolumesActionsTest-246618099 tempest-VolumesActionsTest-246618099-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1263837438", "imageRef": "5d2148a0-3628-4eff-88e9-5686abc0d33e", "flavorRef": "452", "networks": [{"uuid": "337273a9-9ac4-41ec-a7d5-038bc1a82bb8"}]}} {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:10:19.155209 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.network.neutron [None req-955694ca-9eea-404c-8206-999c5916a5a9 tempest-VolumesActionsTest-246618099 tempest-VolumesActionsTest-246618099-project] validate_networks() for [('337273a9-9ac4-41ec-a7d5-038bc1a82bb8', None, None, None, None, None)] {{(pid=117890) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 29 08:10:19.534265 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.virt.hardware [None req-955694ca-9eea-404c-8206-999c5916a5a9 tempest-VolumesActionsTest-246618099 tempest-VolumesActionsTest-246618099-project] Flavor limits 0:0:0 {{(pid=117890) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 29 08:10:19.534691 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.virt.hardware [None req-955694ca-9eea-404c-8206-999c5916a5a9 tempest-VolumesActionsTest-246618099 tempest-VolumesActionsTest-246618099-project] Image limits 0:0:0 {{(pid=117890) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 29 08:10:19.535163 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.virt.hardware [None req-955694ca-9eea-404c-8206-999c5916a5a9 tempest-VolumesActionsTest-246618099 tempest-VolumesActionsTest-246618099-project] Flavor pref 0:0:0 {{(pid=117890) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 29 08:10:19.535571 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.virt.hardware [None req-955694ca-9eea-404c-8206-999c5916a5a9 tempest-VolumesActionsTest-246618099 tempest-VolumesActionsTest-246618099-project] Image pref 0:0:0 {{(pid=117890) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 29 08:10:19.535977 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.virt.hardware [None req-955694ca-9eea-404c-8206-999c5916a5a9 tempest-VolumesActionsTest-246618099 tempest-VolumesActionsTest-246618099-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117890) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 29 08:10:19.545725 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-955694ca-9eea-404c-8206-999c5916a5a9 tempest-VolumesActionsTest-246618099 tempest-VolumesActionsTest-246618099-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:10:19.546167 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-955694ca-9eea-404c-8206-999c5916a5a9 tempest-VolumesActionsTest-246618099 tempest-VolumesActionsTest-246618099-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:10:19.546957 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-955694ca-9eea-404c-8206-999c5916a5a9 tempest-VolumesActionsTest-246618099 tempest-VolumesActionsTest-246618099-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:10:19.547384 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-955694ca-9eea-404c-8206-999c5916a5a9 tempest-VolumesActionsTest-246618099 tempest-VolumesActionsTest-246618099-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:10:19.566536 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.quota [None req-955694ca-9eea-404c-8206-999c5916a5a9 tempest-VolumesActionsTest-246618099 tempest-VolumesActionsTest-246618099-project] Getting quotas for project 941e14f704b74aa7afe5ef3a75a3f24b. Resources: {'ram', 'instances', 'cores'} {{(pid=117890) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 29 08:10:19.571476 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.quota [None req-955694ca-9eea-404c-8206-999c5916a5a9 tempest-VolumesActionsTest-246618099 tempest-VolumesActionsTest-246618099-project] Getting quotas for user b887b672801d436a80fde4c5b2f8ad61 and project 941e14f704b74aa7afe5ef3a75a3f24b. Resources: {'ram', 'instances', 'cores'} {{(pid=117890) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 29 08:10:19.584588 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-955694ca-9eea-404c-8206-999c5916a5a9 tempest-VolumesActionsTest-246618099 tempest-VolumesActionsTest-246618099-project] Going to run 1 instances... {{(pid=117890) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 29 08:10:19.586954 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-955694ca-9eea-404c-8206-999c5916a5a9 tempest-VolumesActionsTest-246618099 tempest-VolumesActionsTest-246618099-project] [instance: 8c1fe8b6-4e29-4292-92a3-a687fadeb6a1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5d2148a0-3628-4eff-88e9-5686abc0d33e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117890) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 29 08:10:19.636794 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-955694ca-9eea-404c-8206-999c5916a5a9 tempest-VolumesActionsTest-246618099 tempest-VolumesActionsTest-246618099-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.539737 Jun 29 08:10:19.637493 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 409/828] 10.222.0.43 () {60 vars in 1146 bytes} [Wed Jun 29 08:10:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 541 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 29 08:10:19.648625 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-5c6f43e6-5d66-4ca6-911a-9da975282917 tempest-VolumesActionsTest-246618099 tempest-VolumesActionsTest-246618099-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:10:19.649289 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-5c6f43e6-5d66-4ca6-911a-9da975282917 tempest-VolumesActionsTest-246618099 tempest-VolumesActionsTest-246618099-project] [instance: 8c1fe8b6-4e29-4292-92a3-a687fadeb6a1] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:10:19.714749 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-5c6f43e6-5d66-4ca6-911a-9da975282917 tempest-VolumesActionsTest-246618099 tempest-VolumesActionsTest-246618099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b887b672801d436a80fde4c5b2f8ad61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '941e14f704b74aa7afe5ef3a75a3f24b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:10:19.722490 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-5c6f43e6-5d66-4ca6-911a-9da975282917 tempest-VolumesActionsTest-246618099 tempest-VolumesActionsTest-246618099-project] 10.222.0.43 "GET /compute/v2.1/servers/8c1fe8b6-4e29-4292-92a3-a687fadeb6a1" status: 200 len: 1214 microversion: 2.1 time: 0.078090 Jun 29 08:10:19.723377 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 420/829] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:10:19 2022] GET /compute/v2.1/servers/8c1fe8b6-4e29-4292-92a3-a687fadeb6a1 => generated 1214 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:10:20.740391 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-cf7465c3-47e2-40ab-9ccb-5090865f155d tempest-VolumesActionsTest-246618099 tempest-VolumesActionsTest-246618099-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:10:20.740998 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-cf7465c3-47e2-40ab-9ccb-5090865f155d tempest-VolumesActionsTest-246618099 tempest-VolumesActionsTest-246618099-project] [instance: 8c1fe8b6-4e29-4292-92a3-a687fadeb6a1] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:10:20.759323 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-cf7465c3-47e2-40ab-9ccb-5090865f155d tempest-VolumesActionsTest-246618099 tempest-VolumesActionsTest-246618099-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:10:20.759870 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-cf7465c3-47e2-40ab-9ccb-5090865f155d tempest-VolumesActionsTest-246618099 tempest-VolumesActionsTest-246618099-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:10:20.760922 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-cf7465c3-47e2-40ab-9ccb-5090865f155d tempest-VolumesActionsTest-246618099 tempest-VolumesActionsTest-246618099-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:10:20.761451 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-cf7465c3-47e2-40ab-9ccb-5090865f155d tempest-VolumesActionsTest-246618099 tempest-VolumesActionsTest-246618099-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:10:20.834899 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-cf7465c3-47e2-40ab-9ccb-5090865f155d tempest-VolumesActionsTest-246618099 tempest-VolumesActionsTest-246618099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b887b672801d436a80fde4c5b2f8ad61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '941e14f704b74aa7afe5ef3a75a3f24b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:10:20.843584 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-cf7465c3-47e2-40ab-9ccb-5090865f155d tempest-VolumesActionsTest-246618099 tempest-VolumesActionsTest-246618099-project] 10.222.0.43 "GET /compute/v2.1/servers/8c1fe8b6-4e29-4292-92a3-a687fadeb6a1" status: 200 len: 1274 microversion: 2.1 time: 0.107625 Jun 29 08:10:20.844169 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 410/830] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:10:20 2022] GET /compute/v2.1/servers/8c1fe8b6-4e29-4292-92a3-a687fadeb6a1 => generated 1274 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:10:21.861578 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-2e7e21b8-ff3e-4751-8414-9fdb3edb586c tempest-VolumesActionsTest-246618099 tempest-VolumesActionsTest-246618099-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:10:21.863354 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-2e7e21b8-ff3e-4751-8414-9fdb3edb586c tempest-VolumesActionsTest-246618099 tempest-VolumesActionsTest-246618099-project] [instance: 8c1fe8b6-4e29-4292-92a3-a687fadeb6a1] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:10:21.871423 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-2e7e21b8-ff3e-4751-8414-9fdb3edb586c tempest-VolumesActionsTest-246618099 tempest-VolumesActionsTest-246618099-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:10:21.871873 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-2e7e21b8-ff3e-4751-8414-9fdb3edb586c tempest-VolumesActionsTest-246618099 tempest-VolumesActionsTest-246618099-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:10:21.873205 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-2e7e21b8-ff3e-4751-8414-9fdb3edb586c tempest-VolumesActionsTest-246618099 tempest-VolumesActionsTest-246618099-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:10:21.873647 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-2e7e21b8-ff3e-4751-8414-9fdb3edb586c tempest-VolumesActionsTest-246618099 tempest-VolumesActionsTest-246618099-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:10:22.096383 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-2e7e21b8-ff3e-4751-8414-9fdb3edb586c tempest-VolumesActionsTest-246618099 tempest-VolumesActionsTest-246618099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b887b672801d436a80fde4c5b2f8ad61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '941e14f704b74aa7afe5ef3a75a3f24b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:10:22.104717 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-2e7e21b8-ff3e-4751-8414-9fdb3edb586c tempest-VolumesActionsTest-246618099 tempest-VolumesActionsTest-246618099-project] 10.222.0.43 "GET /compute/v2.1/servers/8c1fe8b6-4e29-4292-92a3-a687fadeb6a1" status: 200 len: 1314 microversion: 2.1 time: 0.246984 Jun 29 08:10:22.105357 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 421/831] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:10:21 2022] GET /compute/v2.1/servers/8c1fe8b6-4e29-4292-92a3-a687fadeb6a1 => generated 1314 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:10:22.237728 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [req-a8ad5de0-7634-413b-bb3a-b948b0263bd3 req-87e751e0-2435-43f0-b8f9-d1a410b95466 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8c1fe8b6-4e29-4292-92a3-a687fadeb6a1", "tag": "1eefdfdc-1116-4e6b-9440-f1edd39c5cdf"}]} {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:10:22.248254 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [req-a8ad5de0-7634-413b-bb3a-b948b0263bd3 req-87e751e0-2435-43f0-b8f9-d1a410b95466 service nova] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:10:22.249248 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [req-a8ad5de0-7634-413b-bb3a-b948b0263bd3 req-87e751e0-2435-43f0-b8f9-d1a410b95466 service nova] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:10:22.261295 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.compute.server_external_events [req-a8ad5de0-7634-413b-bb3a-b948b0263bd3 req-87e751e0-2435-43f0-b8f9-d1a410b95466 service nova] Creating event network-changed:1eefdfdc-1116-4e6b-9440-f1edd39c5cdf for instance 8c1fe8b6-4e29-4292-92a3-a687fadeb6a1 on hv-cinder-76810 Jun 29 08:10:22.267190 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [req-a8ad5de0-7634-413b-bb3a-b948b0263bd3 req-87e751e0-2435-43f0-b8f9-d1a410b95466 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033216 Jun 29 08:10:22.267805 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 411/832] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jun 29 08:10:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:10:23.123028 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-eb7ba2f7-b173-4de8-bc3f-db416c9b6cbd tempest-VolumesActionsTest-246618099 tempest-VolumesActionsTest-246618099-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:10:23.123637 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-eb7ba2f7-b173-4de8-bc3f-db416c9b6cbd tempest-VolumesActionsTest-246618099 tempest-VolumesActionsTest-246618099-project] [instance: 8c1fe8b6-4e29-4292-92a3-a687fadeb6a1] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:10:23.130771 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-eb7ba2f7-b173-4de8-bc3f-db416c9b6cbd tempest-VolumesActionsTest-246618099 tempest-VolumesActionsTest-246618099-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:10:23.131216 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-eb7ba2f7-b173-4de8-bc3f-db416c9b6cbd tempest-VolumesActionsTest-246618099 tempest-VolumesActionsTest-246618099-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:10:23.131978 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-eb7ba2f7-b173-4de8-bc3f-db416c9b6cbd tempest-VolumesActionsTest-246618099 tempest-VolumesActionsTest-246618099-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:10:23.132418 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-eb7ba2f7-b173-4de8-bc3f-db416c9b6cbd tempest-VolumesActionsTest-246618099 tempest-VolumesActionsTest-246618099-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:10:23.135077 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_cell1:SELECT=92 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:10:23.264052 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-eb7ba2f7-b173-4de8-bc3f-db416c9b6cbd tempest-VolumesActionsTest-246618099 tempest-VolumesActionsTest-246618099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b887b672801d436a80fde4c5b2f8ad61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '941e14f704b74aa7afe5ef3a75a3f24b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:10:23.272262 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-eb7ba2f7-b173-4de8-bc3f-db416c9b6cbd tempest-VolumesActionsTest-246618099 tempest-VolumesActionsTest-246618099-project] 10.222.0.43 "GET /compute/v2.1/servers/8c1fe8b6-4e29-4292-92a3-a687fadeb6a1" status: 200 len: 1314 microversion: 2.1 time: 0.153196 Jun 29 08:10:23.272820 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 422/833] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:10:23 2022] GET /compute/v2.1/servers/8c1fe8b6-4e29-4292-92a3-a687fadeb6a1 => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:10:24.291396 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-84a38388-ab98-443d-9c26-3708d5d6f9d9 tempest-VolumesActionsTest-246618099 tempest-VolumesActionsTest-246618099-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:10:24.292089 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-84a38388-ab98-443d-9c26-3708d5d6f9d9 tempest-VolumesActionsTest-246618099 tempest-VolumesActionsTest-246618099-project] [instance: 8c1fe8b6-4e29-4292-92a3-a687fadeb6a1] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:10:24.298428 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-84a38388-ab98-443d-9c26-3708d5d6f9d9 tempest-VolumesActionsTest-246618099 tempest-VolumesActionsTest-246618099-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:10:24.298874 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-84a38388-ab98-443d-9c26-3708d5d6f9d9 tempest-VolumesActionsTest-246618099 tempest-VolumesActionsTest-246618099-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:10:24.299632 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-84a38388-ab98-443d-9c26-3708d5d6f9d9 tempest-VolumesActionsTest-246618099 tempest-VolumesActionsTest-246618099-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:10:24.300066 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-84a38388-ab98-443d-9c26-3708d5d6f9d9 tempest-VolumesActionsTest-246618099 tempest-VolumesActionsTest-246618099-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:10:24.433260 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-84a38388-ab98-443d-9c26-3708d5d6f9d9 tempest-VolumesActionsTest-246618099 tempest-VolumesActionsTest-246618099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b887b672801d436a80fde4c5b2f8ad61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '941e14f704b74aa7afe5ef3a75a3f24b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:10:24.442677 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-84a38388-ab98-443d-9c26-3708d5d6f9d9 tempest-VolumesActionsTest-246618099 tempest-VolumesActionsTest-246618099-project] 10.222.0.43 "GET /compute/v2.1/servers/8c1fe8b6-4e29-4292-92a3-a687fadeb6a1" status: 200 len: 1314 microversion: 2.1 time: 0.156642 Jun 29 08:10:24.443272 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 412/834] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:10:24 2022] GET /compute/v2.1/servers/8c1fe8b6-4e29-4292-92a3-a687fadeb6a1 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:10:25.460485 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-0e408783-660c-4f84-b0ab-c06c883675bd tempest-VolumesActionsTest-246618099 tempest-VolumesActionsTest-246618099-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:10:25.461079 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-0e408783-660c-4f84-b0ab-c06c883675bd tempest-VolumesActionsTest-246618099 tempest-VolumesActionsTest-246618099-project] [instance: 8c1fe8b6-4e29-4292-92a3-a687fadeb6a1] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:10:25.467619 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-0e408783-660c-4f84-b0ab-c06c883675bd tempest-VolumesActionsTest-246618099 tempest-VolumesActionsTest-246618099-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:10:25.468080 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-0e408783-660c-4f84-b0ab-c06c883675bd tempest-VolumesActionsTest-246618099 tempest-VolumesActionsTest-246618099-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:10:25.468910 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-0e408783-660c-4f84-b0ab-c06c883675bd tempest-VolumesActionsTest-246618099 tempest-VolumesActionsTest-246618099-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:10:25.469373 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-0e408783-660c-4f84-b0ab-c06c883675bd tempest-VolumesActionsTest-246618099 tempest-VolumesActionsTest-246618099-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:10:25.622696 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-0e408783-660c-4f84-b0ab-c06c883675bd tempest-VolumesActionsTest-246618099 tempest-VolumesActionsTest-246618099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b887b672801d436a80fde4c5b2f8ad61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '941e14f704b74aa7afe5ef3a75a3f24b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:10:25.637271 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-0e408783-660c-4f84-b0ab-c06c883675bd tempest-VolumesActionsTest-246618099 tempest-VolumesActionsTest-246618099-project] 10.222.0.43 "GET /compute/v2.1/servers/8c1fe8b6-4e29-4292-92a3-a687fadeb6a1" status: 200 len: 1314 microversion: 2.1 time: 0.180771 Jun 29 08:10:25.637869 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 423/835] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:10:25 2022] GET /compute/v2.1/servers/8c1fe8b6-4e29-4292-92a3-a687fadeb6a1 => generated 1314 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:10:26.656197 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-1a755fa7-249f-42df-8241-c0b417ed7ca9 tempest-VolumesActionsTest-246618099 tempest-VolumesActionsTest-246618099-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:10:26.657519 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-1a755fa7-249f-42df-8241-c0b417ed7ca9 tempest-VolumesActionsTest-246618099 tempest-VolumesActionsTest-246618099-project] [instance: 8c1fe8b6-4e29-4292-92a3-a687fadeb6a1] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:10:26.660009 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG dbcounter [-] [117890] Writing DB stats nova_api:SELECT=77,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=117890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:10:26.665571 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-1a755fa7-249f-42df-8241-c0b417ed7ca9 tempest-VolumesActionsTest-246618099 tempest-VolumesActionsTest-246618099-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:10:26.666037 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-1a755fa7-249f-42df-8241-c0b417ed7ca9 tempest-VolumesActionsTest-246618099 tempest-VolumesActionsTest-246618099-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:10:26.666799 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-1a755fa7-249f-42df-8241-c0b417ed7ca9 tempest-VolumesActionsTest-246618099 tempest-VolumesActionsTest-246618099-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:10:26.667266 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-1a755fa7-249f-42df-8241-c0b417ed7ca9 tempest-VolumesActionsTest-246618099 tempest-VolumesActionsTest-246618099-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:10:26.798177 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-1a755fa7-249f-42df-8241-c0b417ed7ca9 tempest-VolumesActionsTest-246618099 tempest-VolumesActionsTest-246618099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b887b672801d436a80fde4c5b2f8ad61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '941e14f704b74aa7afe5ef3a75a3f24b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:10:26.805840 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-1a755fa7-249f-42df-8241-c0b417ed7ca9 tempest-VolumesActionsTest-246618099 tempest-VolumesActionsTest-246618099-project] 10.222.0.43 "GET /compute/v2.1/servers/8c1fe8b6-4e29-4292-92a3-a687fadeb6a1" status: 200 len: 1314 microversion: 2.1 time: 0.154133 Jun 29 08:10:26.806520 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 413/836] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:10:26 2022] GET /compute/v2.1/servers/8c1fe8b6-4e29-4292-92a3-a687fadeb6a1 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:10:27.474120 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [req-e10bcbae-d288-4dd3-b8c8-14031989a192 req-ba0e3f6f-58d1-4d88-9aa7-eb10272f4765 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c1fe8b6-4e29-4292-92a3-a687fadeb6a1", "name": "network-vif-plugged", "status": "completed", "tag": "1eefdfdc-1116-4e6b-9440-f1edd39c5cdf"}]} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:10:27.485544 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-e10bcbae-d288-4dd3-b8c8-14031989a192 req-ba0e3f6f-58d1-4d88-9aa7-eb10272f4765 service nova] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:10:27.485544 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-e10bcbae-d288-4dd3-b8c8-14031989a192 req-ba0e3f6f-58d1-4d88-9aa7-eb10272f4765 service nova] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:10:27.498960 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.compute.server_external_events [req-e10bcbae-d288-4dd3-b8c8-14031989a192 req-ba0e3f6f-58d1-4d88-9aa7-eb10272f4765 service nova] Creating event network-vif-plugged:1eefdfdc-1116-4e6b-9440-f1edd39c5cdf for instance 8c1fe8b6-4e29-4292-92a3-a687fadeb6a1 on hv-cinder-76810 Jun 29 08:10:27.504113 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [req-e10bcbae-d288-4dd3-b8c8-14031989a192 req-ba0e3f6f-58d1-4d88-9aa7-eb10272f4765 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036019 Jun 29 08:10:27.504715 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 424/837] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jun 29 08:10:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:10:27.822912 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-b49e3c18-018c-4c5e-8e98-659116c15e8d tempest-VolumesActionsTest-246618099 tempest-VolumesActionsTest-246618099-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:10:27.823445 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-b49e3c18-018c-4c5e-8e98-659116c15e8d tempest-VolumesActionsTest-246618099 tempest-VolumesActionsTest-246618099-project] [instance: 8c1fe8b6-4e29-4292-92a3-a687fadeb6a1] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:10:27.830733 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-b49e3c18-018c-4c5e-8e98-659116c15e8d tempest-VolumesActionsTest-246618099 tempest-VolumesActionsTest-246618099-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:10:27.831203 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-b49e3c18-018c-4c5e-8e98-659116c15e8d tempest-VolumesActionsTest-246618099 tempest-VolumesActionsTest-246618099-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:10:27.831978 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-b49e3c18-018c-4c5e-8e98-659116c15e8d tempest-VolumesActionsTest-246618099 tempest-VolumesActionsTest-246618099-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:10:27.832407 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-b49e3c18-018c-4c5e-8e98-659116c15e8d tempest-VolumesActionsTest-246618099 tempest-VolumesActionsTest-246618099-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:10:27.969812 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-b49e3c18-018c-4c5e-8e98-659116c15e8d tempest-VolumesActionsTest-246618099 tempest-VolumesActionsTest-246618099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b887b672801d436a80fde4c5b2f8ad61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '941e14f704b74aa7afe5ef3a75a3f24b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:10:27.973203 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG dbcounter [-] [117890] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:10:27.978075 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-b49e3c18-018c-4c5e-8e98-659116c15e8d tempest-VolumesActionsTest-246618099 tempest-VolumesActionsTest-246618099-project] 10.222.0.43 "GET /compute/v2.1/servers/8c1fe8b6-4e29-4292-92a3-a687fadeb6a1" status: 200 len: 1314 microversion: 2.1 time: 0.159107 Jun 29 08:10:27.978645 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 414/838] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:10:27 2022] GET /compute/v2.1/servers/8c1fe8b6-4e29-4292-92a3-a687fadeb6a1 => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:10:28.996487 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-4862e2c2-be3a-418a-b36b-90abc9fdc939 tempest-VolumesActionsTest-246618099 tempest-VolumesActionsTest-246618099-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:10:28.997209 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-4862e2c2-be3a-418a-b36b-90abc9fdc939 tempest-VolumesActionsTest-246618099 tempest-VolumesActionsTest-246618099-project] [instance: 8c1fe8b6-4e29-4292-92a3-a687fadeb6a1] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:10:28.999144 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_api:SELECT=72,nova_api:INSERT=4 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:10:29.005288 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-4862e2c2-be3a-418a-b36b-90abc9fdc939 tempest-VolumesActionsTest-246618099 tempest-VolumesActionsTest-246618099-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:10:29.005739 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-4862e2c2-be3a-418a-b36b-90abc9fdc939 tempest-VolumesActionsTest-246618099 tempest-VolumesActionsTest-246618099-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:10:29.006512 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-4862e2c2-be3a-418a-b36b-90abc9fdc939 tempest-VolumesActionsTest-246618099 tempest-VolumesActionsTest-246618099-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:10:29.006940 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-4862e2c2-be3a-418a-b36b-90abc9fdc939 tempest-VolumesActionsTest-246618099 tempest-VolumesActionsTest-246618099-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:10:29.140825 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-4862e2c2-be3a-418a-b36b-90abc9fdc939 tempest-VolumesActionsTest-246618099 tempest-VolumesActionsTest-246618099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b887b672801d436a80fde4c5b2f8ad61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '941e14f704b74aa7afe5ef3a75a3f24b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:10:29.148524 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-4862e2c2-be3a-418a-b36b-90abc9fdc939 tempest-VolumesActionsTest-246618099 tempest-VolumesActionsTest-246618099-project] 10.222.0.43 "GET /compute/v2.1/servers/8c1fe8b6-4e29-4292-92a3-a687fadeb6a1" status: 200 len: 1314 microversion: 2.1 time: 0.156680 Jun 29 08:10:29.149111 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 425/839] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:10:28 2022] GET /compute/v2.1/servers/8c1fe8b6-4e29-4292-92a3-a687fadeb6a1 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:10:30.166891 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-b3ae9683-6e2b-45d7-867f-847e60f4e405 tempest-VolumesActionsTest-246618099 tempest-VolumesActionsTest-246618099-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:10:30.167514 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-b3ae9683-6e2b-45d7-867f-847e60f4e405 tempest-VolumesActionsTest-246618099 tempest-VolumesActionsTest-246618099-project] [instance: 8c1fe8b6-4e29-4292-92a3-a687fadeb6a1] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:10:30.169875 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG dbcounter [-] [117890] Writing DB stats nova_cell0:SELECT=2 {{(pid=117890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:10:30.170530 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG dbcounter [-] [117890] Writing DB stats nova_cell0:SELECT=6 {{(pid=117890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:10:30.178737 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-b3ae9683-6e2b-45d7-867f-847e60f4e405 tempest-VolumesActionsTest-246618099 tempest-VolumesActionsTest-246618099-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:10:30.179584 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-b3ae9683-6e2b-45d7-867f-847e60f4e405 tempest-VolumesActionsTest-246618099 tempest-VolumesActionsTest-246618099-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:10:30.179963 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-b3ae9683-6e2b-45d7-867f-847e60f4e405 tempest-VolumesActionsTest-246618099 tempest-VolumesActionsTest-246618099-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:10:30.180398 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-b3ae9683-6e2b-45d7-867f-847e60f4e405 tempest-VolumesActionsTest-246618099 tempest-VolumesActionsTest-246618099-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:10:30.320276 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-b3ae9683-6e2b-45d7-867f-847e60f4e405 tempest-VolumesActionsTest-246618099 tempest-VolumesActionsTest-246618099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b887b672801d436a80fde4c5b2f8ad61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '941e14f704b74aa7afe5ef3a75a3f24b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:10:30.328885 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-b3ae9683-6e2b-45d7-867f-847e60f4e405 tempest-VolumesActionsTest-246618099 tempest-VolumesActionsTest-246618099-project] 10.222.0.43 "GET /compute/v2.1/servers/8c1fe8b6-4e29-4292-92a3-a687fadeb6a1" status: 200 len: 1498 microversion: 2.1 time: 0.166470 Jun 29 08:10:30.329510 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 415/840] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:10:30 2022] GET /compute/v2.1/servers/8c1fe8b6-4e29-4292-92a3-a687fadeb6a1 => generated 1498 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:10:30.881755 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-b872cee0-e1e9-4644-9f2f-d11fdbff5923 tempest-VolumesActionsTest-246618099 tempest-VolumesActionsTest-246618099-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:10:30.882279 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-b872cee0-e1e9-4644-9f2f-d11fdbff5923 tempest-VolumesActionsTest-246618099 tempest-VolumesActionsTest-246618099-project] [instance: 8c1fe8b6-4e29-4292-92a3-a687fadeb6a1] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:10:30.884065 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_cell0:SELECT=2 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:10:30.890427 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-b872cee0-e1e9-4644-9f2f-d11fdbff5923 tempest-VolumesActionsTest-246618099 tempest-VolumesActionsTest-246618099-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:10:30.891092 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-b872cee0-e1e9-4644-9f2f-d11fdbff5923 tempest-VolumesActionsTest-246618099 tempest-VolumesActionsTest-246618099-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:10:30.891678 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-b872cee0-e1e9-4644-9f2f-d11fdbff5923 tempest-VolumesActionsTest-246618099 tempest-VolumesActionsTest-246618099-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:10:30.892119 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-b872cee0-e1e9-4644-9f2f-d11fdbff5923 tempest-VolumesActionsTest-246618099 tempest-VolumesActionsTest-246618099-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:10:30.917254 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-b872cee0-e1e9-4644-9f2f-d11fdbff5923 tempest-VolumesActionsTest-246618099 tempest-VolumesActionsTest-246618099-project] [instance: 8c1fe8b6-4e29-4292-92a3-a687fadeb6a1] Going to try to terminate instance {{(pid=117889) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 29 08:10:30.998356 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-b872cee0-e1e9-4644-9f2f-d11fdbff5923 tempest-VolumesActionsTest-246618099 tempest-VolumesActionsTest-246618099-project] 10.222.0.43 "DELETE /compute/v2.1/servers/8c1fe8b6-4e29-4292-92a3-a687fadeb6a1" status: 204 len: 0 microversion: 2.1 time: 0.120190 Jun 29 08:10:30.999706 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 426/841] 10.222.0.43 () {58 vars in 1238 bytes} [Wed Jun 29 08:10:30 2022] DELETE /compute/v2.1/servers/8c1fe8b6-4e29-4292-92a3-a687fadeb6a1 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 29 08:10:31.008107 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-dbd13c67-386a-4a5e-8b39-e70e77d219a1 tempest-VolumesActionsTest-246618099 tempest-VolumesActionsTest-246618099-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:10:31.008708 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-dbd13c67-386a-4a5e-8b39-e70e77d219a1 tempest-VolumesActionsTest-246618099 tempest-VolumesActionsTest-246618099-project] [instance: 8c1fe8b6-4e29-4292-92a3-a687fadeb6a1] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:10:31.014695 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-dbd13c67-386a-4a5e-8b39-e70e77d219a1 tempest-VolumesActionsTest-246618099 tempest-VolumesActionsTest-246618099-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:10:31.015777 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-dbd13c67-386a-4a5e-8b39-e70e77d219a1 tempest-VolumesActionsTest-246618099 tempest-VolumesActionsTest-246618099-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:10:31.017023 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-dbd13c67-386a-4a5e-8b39-e70e77d219a1 tempest-VolumesActionsTest-246618099 tempest-VolumesActionsTest-246618099-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:10:31.017624 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-dbd13c67-386a-4a5e-8b39-e70e77d219a1 tempest-VolumesActionsTest-246618099 tempest-VolumesActionsTest-246618099-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:10:31.148756 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-dbd13c67-386a-4a5e-8b39-e70e77d219a1 tempest-VolumesActionsTest-246618099 tempest-VolumesActionsTest-246618099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b887b672801d436a80fde4c5b2f8ad61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '941e14f704b74aa7afe5ef3a75a3f24b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:10:31.156297 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-dbd13c67-386a-4a5e-8b39-e70e77d219a1 tempest-VolumesActionsTest-246618099 tempest-VolumesActionsTest-246618099-project] 10.222.0.43 "GET /compute/v2.1/servers/8c1fe8b6-4e29-4292-92a3-a687fadeb6a1" status: 200 len: 1504 microversion: 2.1 time: 0.152017 Jun 29 08:10:31.156858 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 416/842] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:10:31 2022] GET /compute/v2.1/servers/8c1fe8b6-4e29-4292-92a3-a687fadeb6a1 => generated 1504 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:10:32.174460 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-66f38326-1ec6-497e-8ad2-e73f3f3e6b7a tempest-VolumesActionsTest-246618099 tempest-VolumesActionsTest-246618099-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:10:32.175156 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-66f38326-1ec6-497e-8ad2-e73f3f3e6b7a tempest-VolumesActionsTest-246618099 tempest-VolumesActionsTest-246618099-project] [instance: 8c1fe8b6-4e29-4292-92a3-a687fadeb6a1] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:10:32.182196 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-66f38326-1ec6-497e-8ad2-e73f3f3e6b7a tempest-VolumesActionsTest-246618099 tempest-VolumesActionsTest-246618099-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:10:32.182627 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-66f38326-1ec6-497e-8ad2-e73f3f3e6b7a tempest-VolumesActionsTest-246618099 tempest-VolumesActionsTest-246618099-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:10:32.183402 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-66f38326-1ec6-497e-8ad2-e73f3f3e6b7a tempest-VolumesActionsTest-246618099 tempest-VolumesActionsTest-246618099-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:10:32.183839 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-66f38326-1ec6-497e-8ad2-e73f3f3e6b7a tempest-VolumesActionsTest-246618099 tempest-VolumesActionsTest-246618099-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:10:32.318444 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-66f38326-1ec6-497e-8ad2-e73f3f3e6b7a tempest-VolumesActionsTest-246618099 tempest-VolumesActionsTest-246618099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b887b672801d436a80fde4c5b2f8ad61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '941e14f704b74aa7afe5ef3a75a3f24b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:10:32.326073 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-66f38326-1ec6-497e-8ad2-e73f3f3e6b7a tempest-VolumesActionsTest-246618099 tempest-VolumesActionsTest-246618099-project] 10.222.0.43 "GET /compute/v2.1/servers/8c1fe8b6-4e29-4292-92a3-a687fadeb6a1" status: 200 len: 1504 microversion: 2.1 time: 0.156276 Jun 29 08:10:32.326639 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 427/843] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:10:32 2022] GET /compute/v2.1/servers/8c1fe8b6-4e29-4292-92a3-a687fadeb6a1 => generated 1504 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:10:32.969698 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-811a8a9f-0799-4a9c-a0f8-c5cfacbfeb2d tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:10:32.970713 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-811a8a9f-0799-4a9c-a0f8-c5cfacbfeb2d tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] [instance: 4e4c90a0-14de-401e-80d5-fe4bf684d991] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:10:32.977118 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-811a8a9f-0799-4a9c-a0f8-c5cfacbfeb2d tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:10:32.977538 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-811a8a9f-0799-4a9c-a0f8-c5cfacbfeb2d tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:10:32.978314 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-811a8a9f-0799-4a9c-a0f8-c5cfacbfeb2d tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:10:32.978752 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-811a8a9f-0799-4a9c-a0f8-c5cfacbfeb2d tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:10:33.008750 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-811a8a9f-0799-4a9c-a0f8-c5cfacbfeb2d tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] 10.222.0.43 "GET /compute/v2.1/servers/4e4c90a0-14de-401e-80d5-fe4bf684d991/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.043531 Jun 29 08:10:33.009572 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 417/844] 10.222.0.43 () {60 vars in 1342 bytes} [Wed Jun 29 08:10:32 2022] GET /compute/v2.1/servers/4e4c90a0-14de-401e-80d5-fe4bf684d991/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:10:33.068235 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-a1f34cc5-a66a-4a28-a94b-d8883a544282 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:10:33.068861 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-a1f34cc5-a66a-4a28-a94b-d8883a544282 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] [instance: 4e4c90a0-14de-401e-80d5-fe4bf684d991] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:10:33.074947 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-a1f34cc5-a66a-4a28-a94b-d8883a544282 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:10:33.075406 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-a1f34cc5-a66a-4a28-a94b-d8883a544282 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:10:33.076186 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-a1f34cc5-a66a-4a28-a94b-d8883a544282 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:10:33.076722 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-a1f34cc5-a66a-4a28-a94b-d8883a544282 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:10:33.103966 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-a1f34cc5-a66a-4a28-a94b-d8883a544282 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] [instance: 4e4c90a0-14de-401e-80d5-fe4bf684d991] Going to try to terminate instance {{(pid=117889) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 29 08:10:33.155183 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [req-e0323f33-cc33-49ba-a400-bccf23ecfa21 req-3cb00012-0b10-4469-ab1b-b07a29e0e369 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c1fe8b6-4e29-4292-92a3-a687fadeb6a1", "name": "network-vif-deleted", "tag": "1eefdfdc-1116-4e6b-9440-f1edd39c5cdf"}]} {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:10:33.166010 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [req-e0323f33-cc33-49ba-a400-bccf23ecfa21 req-3cb00012-0b10-4469-ab1b-b07a29e0e369 service nova] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:10:33.166456 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [req-e0323f33-cc33-49ba-a400-bccf23ecfa21 req-3cb00012-0b10-4469-ab1b-b07a29e0e369 service nova] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:10:33.181306 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.compute.server_external_events [req-e0323f33-cc33-49ba-a400-bccf23ecfa21 req-3cb00012-0b10-4469-ab1b-b07a29e0e369 service nova] Creating event network-vif-deleted:1eefdfdc-1116-4e6b-9440-f1edd39c5cdf for instance 8c1fe8b6-4e29-4292-92a3-a687fadeb6a1 on hv-cinder-76810 Jun 29 08:10:33.187387 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [req-e0323f33-cc33-49ba-a400-bccf23ecfa21 req-3cb00012-0b10-4469-ab1b-b07a29e0e369 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035651 Jun 29 08:10:33.189730 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-a1f34cc5-a66a-4a28-a94b-d8883a544282 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] 10.222.0.43 "DELETE /compute/v2.1/servers/4e4c90a0-14de-401e-80d5-fe4bf684d991" status: 204 len: 0 microversion: 2.20 time: 0.124744 Jun 29 08:10:33.190730 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 428/845] 10.222.0.43 () {60 vars in 1279 bytes} [Wed Jun 29 08:10:33 2022] DELETE /compute/v2.1/servers/4e4c90a0-14de-401e-80d5-fe4bf684d991 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 29 08:10:33.191792 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 418/846] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jun 29 08:10:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 29 08:10:33.199414 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-5bee40ae-ff87-4b0e-89df-ed4e8dfcae96 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:10:33.200119 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-5bee40ae-ff87-4b0e-89df-ed4e8dfcae96 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] [instance: 4e4c90a0-14de-401e-80d5-fe4bf684d991] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:10:33.206437 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-5bee40ae-ff87-4b0e-89df-ed4e8dfcae96 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:10:33.206802 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-5bee40ae-ff87-4b0e-89df-ed4e8dfcae96 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:10:33.207582 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-5bee40ae-ff87-4b0e-89df-ed4e8dfcae96 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:10:33.208407 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-5bee40ae-ff87-4b0e-89df-ed4e8dfcae96 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:10:33.345435 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-871289df-9323-4315-8fe6-4bac71b53b5c tempest-VolumesActionsTest-246618099 tempest-VolumesActionsTest-246618099-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:10:33.346135 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-871289df-9323-4315-8fe6-4bac71b53b5c tempest-VolumesActionsTest-246618099 tempest-VolumesActionsTest-246618099-project] [instance: 8c1fe8b6-4e29-4292-92a3-a687fadeb6a1] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:10:33.350917 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-5bee40ae-ff87-4b0e-89df-ed4e8dfcae96 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:10:33.352413 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-871289df-9323-4315-8fe6-4bac71b53b5c tempest-VolumesActionsTest-246618099 tempest-VolumesActionsTest-246618099-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:10:33.352863 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-871289df-9323-4315-8fe6-4bac71b53b5c tempest-VolumesActionsTest-246618099 tempest-VolumesActionsTest-246618099-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:10:33.353660 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-871289df-9323-4315-8fe6-4bac71b53b5c tempest-VolumesActionsTest-246618099 tempest-VolumesActionsTest-246618099-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:10:33.354099 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-871289df-9323-4315-8fe6-4bac71b53b5c tempest-VolumesActionsTest-246618099 tempest-VolumesActionsTest-246618099-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:10:33.358976 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-5bee40ae-ff87-4b0e-89df-ed4e8dfcae96 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:10:33.360511 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-5bee40ae-ff87-4b0e-89df-ed4e8dfcae96 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:10:33.361947 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-5bee40ae-ff87-4b0e-89df-ed4e8dfcae96 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] 10.222.0.43 "GET /compute/v2.1/servers/4e4c90a0-14de-401e-80d5-fe4bf684d991" status: 200 len: 1723 microversion: 2.20 time: 0.166974 Jun 29 08:10:33.362511 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 429/847] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 29 08:10:33 2022] GET /compute/v2.1/servers/4e4c90a0-14de-401e-80d5-fe4bf684d991 => generated 1723 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:10:33.420161 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-871289df-9323-4315-8fe6-4bac71b53b5c tempest-VolumesActionsTest-246618099 tempest-VolumesActionsTest-246618099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b887b672801d436a80fde4c5b2f8ad61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '941e14f704b74aa7afe5ef3a75a3f24b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:10:33.428049 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-871289df-9323-4315-8fe6-4bac71b53b5c tempest-VolumesActionsTest-246618099 tempest-VolumesActionsTest-246618099-project] 10.222.0.43 "GET /compute/v2.1/servers/8c1fe8b6-4e29-4292-92a3-a687fadeb6a1" status: 200 len: 1299 microversion: 2.1 time: 0.087551 Jun 29 08:10:33.428650 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 419/848] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:10:33 2022] GET /compute/v2.1/servers/8c1fe8b6-4e29-4292-92a3-a687fadeb6a1 => generated 1299 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 08:10:34.381674 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-32c60a69-319e-4931-ac2b-c8092426ed6e tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:10:34.382276 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-32c60a69-319e-4931-ac2b-c8092426ed6e tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] [instance: 4e4c90a0-14de-401e-80d5-fe4bf684d991] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:10:34.388758 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-32c60a69-319e-4931-ac2b-c8092426ed6e tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:10:34.389239 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-32c60a69-319e-4931-ac2b-c8092426ed6e tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:10:34.390117 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-32c60a69-319e-4931-ac2b-c8092426ed6e tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:10:34.391516 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-32c60a69-319e-4931-ac2b-c8092426ed6e tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:10:34.445804 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-ce069673-6d94-4d63-a5bb-a2342072d57d tempest-VolumesActionsTest-246618099 tempest-VolumesActionsTest-246618099-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:10:34.447051 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-ce069673-6d94-4d63-a5bb-a2342072d57d tempest-VolumesActionsTest-246618099 tempest-VolumesActionsTest-246618099-project] [instance: 8c1fe8b6-4e29-4292-92a3-a687fadeb6a1] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:10:34.454866 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-ce069673-6d94-4d63-a5bb-a2342072d57d tempest-VolumesActionsTest-246618099 tempest-VolumesActionsTest-246618099-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:10:34.455864 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-ce069673-6d94-4d63-a5bb-a2342072d57d tempest-VolumesActionsTest-246618099 tempest-VolumesActionsTest-246618099-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:10:34.456773 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-ce069673-6d94-4d63-a5bb-a2342072d57d tempest-VolumesActionsTest-246618099 tempest-VolumesActionsTest-246618099-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:10:34.457239 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-ce069673-6d94-4d63-a5bb-a2342072d57d tempest-VolumesActionsTest-246618099 tempest-VolumesActionsTest-246618099-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:10:34.493871 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-ce069673-6d94-4d63-a5bb-a2342072d57d tempest-VolumesActionsTest-246618099 tempest-VolumesActionsTest-246618099-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:10:34.494523 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-ce069673-6d94-4d63-a5bb-a2342072d57d tempest-VolumesActionsTest-246618099 tempest-VolumesActionsTest-246618099-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:10:34.495229 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.objects.instance [None req-ce069673-6d94-4d63-a5bb-a2342072d57d tempest-VolumesActionsTest-246618099 tempest-VolumesActionsTest-246618099-project] Lazy-loading 'fault' on Instance uuid 8c1fe8b6-4e29-4292-92a3-a687fadeb6a1 {{(pid=117890) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 29 08:10:34.533662 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-32c60a69-319e-4931-ac2b-c8092426ed6e tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:10:34.538535 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-ce069673-6d94-4d63-a5bb-a2342072d57d tempest-VolumesActionsTest-246618099 tempest-VolumesActionsTest-246618099-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b887b672801d436a80fde4c5b2f8ad61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '941e14f704b74aa7afe5ef3a75a3f24b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:10:34.541825 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-32c60a69-319e-4931-ac2b-c8092426ed6e tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:10:34.543326 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-32c60a69-319e-4931-ac2b-c8092426ed6e tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:10:34.544494 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-32c60a69-319e-4931-ac2b-c8092426ed6e tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] 10.222.0.43 "GET /compute/v2.1/servers/4e4c90a0-14de-401e-80d5-fe4bf684d991" status: 200 len: 1723 microversion: 2.20 time: 0.166744 Jun 29 08:10:34.545075 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 430/849] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 29 08:10:34 2022] GET /compute/v2.1/servers/4e4c90a0-14de-401e-80d5-fe4bf684d991 => generated 1723 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 29 08:10:34.546982 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-ce069673-6d94-4d63-a5bb-a2342072d57d tempest-VolumesActionsTest-246618099 tempest-VolumesActionsTest-246618099-project] 10.222.0.43 "GET /compute/v2.1/servers/8c1fe8b6-4e29-4292-92a3-a687fadeb6a1" status: 200 len: 1304 microversion: 2.1 time: 0.104953 Jun 29 08:10:34.547607 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 420/850] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:10:34 2022] GET /compute/v2.1/servers/8c1fe8b6-4e29-4292-92a3-a687fadeb6a1 => generated 1304 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 08:10:35.564299 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-e0c99fba-8e1f-44b1-b391-d17bb4e1ffcd tempest-VolumesActionsTest-246618099 tempest-VolumesActionsTest-246618099-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:10:35.565455 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-4d7562aa-362f-46c7-9e69-32b673606fc9 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:10:35.565927 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-e0c99fba-8e1f-44b1-b391-d17bb4e1ffcd tempest-VolumesActionsTest-246618099 tempest-VolumesActionsTest-246618099-project] [instance: 8c1fe8b6-4e29-4292-92a3-a687fadeb6a1] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:10:35.566073 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-4d7562aa-362f-46c7-9e69-32b673606fc9 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] [instance: 4e4c90a0-14de-401e-80d5-fe4bf684d991] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:10:35.572372 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-4d7562aa-362f-46c7-9e69-32b673606fc9 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:10:35.572586 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e0c99fba-8e1f-44b1-b391-d17bb4e1ffcd tempest-VolumesActionsTest-246618099 tempest-VolumesActionsTest-246618099-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:10:35.573066 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-4d7562aa-362f-46c7-9e69-32b673606fc9 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:10:35.573234 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e0c99fba-8e1f-44b1-b391-d17bb4e1ffcd tempest-VolumesActionsTest-246618099 tempest-VolumesActionsTest-246618099-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:10:35.573672 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-4d7562aa-362f-46c7-9e69-32b673606fc9 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:10:35.574120 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-4d7562aa-362f-46c7-9e69-32b673606fc9 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:10:35.574383 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e0c99fba-8e1f-44b1-b391-d17bb4e1ffcd tempest-VolumesActionsTest-246618099 tempest-VolumesActionsTest-246618099-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:10:35.575047 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-e0c99fba-8e1f-44b1-b391-d17bb4e1ffcd tempest-VolumesActionsTest-246618099 tempest-VolumesActionsTest-246618099-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:10:35.658358 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-4d7562aa-362f-46c7-9e69-32b673606fc9 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:10:35.667186 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-4d7562aa-362f-46c7-9e69-32b673606fc9 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:10:35.668927 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-4d7562aa-362f-46c7-9e69-32b673606fc9 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:10:35.670209 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-4d7562aa-362f-46c7-9e69-32b673606fc9 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] 10.222.0.43 "GET /compute/v2.1/servers/4e4c90a0-14de-401e-80d5-fe4bf684d991" status: 200 len: 1656 microversion: 2.20 time: 0.108610 Jun 29 08:10:35.671399 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 421/851] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 29 08:10:35 2022] GET /compute/v2.1/servers/4e4c90a0-14de-401e-80d5-fe4bf684d991 => generated 1656 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 29 08:10:35.758486 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.wsgi [None req-e0c99fba-8e1f-44b1-b391-d17bb4e1ffcd tempest-VolumesActionsTest-246618099 tempest-VolumesActionsTest-246618099-project] HTTP exception thrown: Instance 8c1fe8b6-4e29-4292-92a3-a687fadeb6a1 could not be found. Jun 29 08:10:35.760130 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-e0c99fba-8e1f-44b1-b391-d17bb4e1ffcd tempest-VolumesActionsTest-246618099 tempest-VolumesActionsTest-246618099-project] Request method failure captured: Jun 29 08:10:35.760130 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: request: GET /compute/v2.1/servers/8c1fe8b6-4e29-4292-92a3-a687fadeb6a1 HTTP/1.1 Jun 29 08:10:35.760130 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: Accept: application/json Jun 29 08:10:35.760130 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: Accept-Encoding: identity Jun 29 08:10:35.760130 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: Connection: close Jun 29 08:10:35.760130 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: Content-Length: 0 Jun 29 08:10:35.760130 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: Content-Type: application/json Jun 29 08:10:35.760130 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: Host: 10.222.0.43 Jun 29 08:10:35.760130 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: Openstack-System-Scope: None Jun 29 08:10:35.760130 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: User-Agent: python-urllib3/1.26.9 Jun 29 08:10:35.760130 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Auth-Token: gAAAAABivAjYnT07Uba9gQL8rE-MVyTnmVSAG9C1ImbvRlzEeip7L3_xSHjl_U2wmlzJDtnTNNZMTq6cW8F5nVv0Cw_xLlIQOss42OS4bL3yUcobdo3alijL-Nk_RUma09ciu6A0Xo6oUN1SbfmnD7maT8Q67c7pHesTMaxsbDZxB7IOmfAnZOI Jun 29 08:10:35.760130 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Domain-Id: None Jun 29 08:10:35.760130 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Domain-Name: None Jun 29 08:10:35.760130 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Identity-Status: Confirmed Jun 29 08:10:35.760130 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Is-Admin-Project: True Jun 29 08:10:35.760130 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Project-Domain-Id: default Jun 29 08:10:35.760130 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Project-Domain-Name: Default Jun 29 08:10:35.760130 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Project-Id: 941e14f704b74aa7afe5ef3a75a3f24b Jun 29 08:10:35.760130 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Project-Name: tempest-VolumesActionsTest-246618099 Jun 29 08:10:35.760130 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Role: member,reader Jun 29 08:10:35.760130 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Roles: member,reader Jun 29 08:10:35.762161 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/941e14f704b74aa7afe5ef3a75a3f24b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_941e14f704b74aa7afe5ef3a75a3f24b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/941e14f704b74aa7afe5ef3a75a3f24b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/941e14f704b74aa7afe5ef3a75a3f24b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Jun 29 08:10:35.762161 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Tenant: tempest-VolumesActionsTest-246618099 Jun 29 08:10:35.762161 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Tenant-Id: 941e14f704b74aa7afe5ef3a75a3f24b Jun 29 08:10:35.762161 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Tenant-Name: tempest-VolumesActionsTest-246618099 Jun 29 08:10:35.762161 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-User: tempest-VolumesActionsTest-246618099-project Jun 29 08:10:35.762161 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-User-Domain-Id: default Jun 29 08:10:35.762161 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-User-Domain-Name: Default Jun 29 08:10:35.762161 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-User-Id: b887b672801d436a80fde4c5b2f8ad61 Jun 29 08:10:35.762161 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-User-Name: tempest-VolumesActionsTest-246618099-project Jun 29 08:10:35.762161 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: method: > Jun 29 08:10:35.762161 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: exception: Instance 8c1fe8b6-4e29-4292-92a3-a687fadeb6a1 could not be found. Jun 29 08:10:35.762161 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: action_args: {'id': '8c1fe8b6-4e29-4292-92a3-a687fadeb6a1'} Jun 29 08:10:35.762938 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 08:10:35.762938 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:10:35.762938 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 29 08:10:35.762938 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 29 08:10:35.762938 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 29 08:10:35.762938 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 29 08:10:35.762938 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 29 08:10:35.762938 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 29 08:10:35.762938 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 29 08:10:35.762938 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 29 08:10:35.762938 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8c1fe8b6-4e29-4292-92a3-a687fadeb6a1 could not be found. Jun 29 08:10:35.762938 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 29 08:10:35.762938 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 08:10:35.762938 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 29 08:10:35.762938 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:10:35.762938 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 08:10:35.762938 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 08:10:35.762938 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 08:10:35.762938 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 08:10:35.762938 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 08:10:35.764254 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 08:10:35.764254 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 29 08:10:35.764254 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 29 08:10:35.764254 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 29 08:10:35.764254 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 29 08:10:35.764254 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 29 08:10:35.764254 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 29 08:10:35.764254 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8c1fe8b6-4e29-4292-92a3-a687fadeb6a1 could not be found. Jun 29 08:10:35.764254 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 29 08:10:35.764254 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 08:10:35.764254 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 29 08:10:35.764254 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:10:35.764254 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 08:10:35.764254 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 08:10:35.764254 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 08:10:35.764254 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 08:10:35.764254 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8c1fe8b6-4e29-4292-92a3-a687fadeb6a1 could not be found. Jun 29 08:10:35.764254 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 29 08:10:35.765951 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-e0c99fba-8e1f-44b1-b391-d17bb4e1ffcd tempest-VolumesActionsTest-246618099 tempest-VolumesActionsTest-246618099-project] Returning 404 to user: Instance 8c1fe8b6-4e29-4292-92a3-a687fadeb6a1 could not be found. {{(pid=117889) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 08:10:35.765951 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-e0c99fba-8e1f-44b1-b391-d17bb4e1ffcd tempest-VolumesActionsTest-246618099 tempest-VolumesActionsTest-246618099-project] 10.222.0.43 "GET /compute/v2.1/servers/8c1fe8b6-4e29-4292-92a3-a687fadeb6a1" status: 404 len: 111 microversion: 2.1 time: 0.201420 Jun 29 08:10:35.765951 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 431/852] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:10:35 2022] GET /compute/v2.1/servers/8c1fe8b6-4e29-4292-92a3-a687fadeb6a1 => generated 111 bytes in 203 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 29 08:10:36.216705 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [req-13af270b-4aae-48ac-8d3f-c54171314ba0 req-4cc9aa8f-5efb-4719-ae34-c8c74c032bb8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e4c90a0-14de-401e-80d5-fe4bf684d991", "name": "network-vif-deleted", "tag": "747dea80-5c60-451c-bba1-3aabe38a1272"}]} {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:10:36.226409 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [req-13af270b-4aae-48ac-8d3f-c54171314ba0 req-4cc9aa8f-5efb-4719-ae34-c8c74c032bb8 service nova] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:10:36.227189 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [req-13af270b-4aae-48ac-8d3f-c54171314ba0 req-4cc9aa8f-5efb-4719-ae34-c8c74c032bb8 service nova] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:10:36.476607 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.compute.server_external_events [req-13af270b-4aae-48ac-8d3f-c54171314ba0 req-4cc9aa8f-5efb-4719-ae34-c8c74c032bb8 service nova] Creating event network-vif-deleted:747dea80-5c60-451c-bba1-3aabe38a1272 for instance 4e4c90a0-14de-401e-80d5-fe4bf684d991 on hv-cinder-76810 Jun 29 08:10:36.481693 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [req-13af270b-4aae-48ac-8d3f-c54171314ba0 req-4cc9aa8f-5efb-4719-ae34-c8c74c032bb8 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.268697 Jun 29 08:10:36.482445 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 422/853] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jun 29 08:10:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 29 08:10:36.695656 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-9cf90fb9-08c9-490c-abc3-8a1617d09ca4 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:10:36.696756 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-9cf90fb9-08c9-490c-abc3-8a1617d09ca4 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] [instance: 4e4c90a0-14de-401e-80d5-fe4bf684d991] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:10:36.713599 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-9cf90fb9-08c9-490c-abc3-8a1617d09ca4 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:10:36.714396 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-9cf90fb9-08c9-490c-abc3-8a1617d09ca4 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:10:36.715649 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-9cf90fb9-08c9-490c-abc3-8a1617d09ca4 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:10:36.716100 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-9cf90fb9-08c9-490c-abc3-8a1617d09ca4 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:10:36.760796 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-9cf90fb9-08c9-490c-abc3-8a1617d09ca4 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:10:36.761962 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-9cf90fb9-08c9-490c-abc3-8a1617d09ca4 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:10:36.762777 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.objects.instance [None req-9cf90fb9-08c9-490c-abc3-8a1617d09ca4 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lazy-loading 'fault' on Instance uuid 4e4c90a0-14de-401e-80d5-fe4bf684d991 {{(pid=117889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 29 08:10:36.817225 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-9cf90fb9-08c9-490c-abc3-8a1617d09ca4 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:10:36.826647 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-9cf90fb9-08c9-490c-abc3-8a1617d09ca4 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:10:36.829294 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-9cf90fb9-08c9-490c-abc3-8a1617d09ca4 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c9065575ed314f6f8f3915bf596911e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4cd09897be9c4642b91dfb53a536e7d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:10:36.830519 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-9cf90fb9-08c9-490c-abc3-8a1617d09ca4 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] 10.222.0.43 "GET /compute/v2.1/servers/4e4c90a0-14de-401e-80d5-fe4bf684d991" status: 200 len: 1371 microversion: 2.20 time: 0.142039 Jun 29 08:10:36.831582 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 432/854] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 29 08:10:36 2022] GET /compute/v2.1/servers/4e4c90a0-14de-401e-80d5-fe4bf684d991 => generated 1371 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 29 08:10:37.850052 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-b7cf055e-b823-4e3a-9496-64ab042516f1 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:10:37.850737 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-b7cf055e-b823-4e3a-9496-64ab042516f1 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] [instance: 4e4c90a0-14de-401e-80d5-fe4bf684d991] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:10:37.857414 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-b7cf055e-b823-4e3a-9496-64ab042516f1 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:10:37.857859 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-b7cf055e-b823-4e3a-9496-64ab042516f1 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:10:37.858607 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-b7cf055e-b823-4e3a-9496-64ab042516f1 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:10:37.859086 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-b7cf055e-b823-4e3a-9496-64ab042516f1 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:10:37.872263 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.wsgi [None req-b7cf055e-b823-4e3a-9496-64ab042516f1 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] HTTP exception thrown: Instance 4e4c90a0-14de-401e-80d5-fe4bf684d991 could not be found. Jun 29 08:10:37.873907 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-b7cf055e-b823-4e3a-9496-64ab042516f1 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Request method failure captured: Jun 29 08:10:37.873907 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: request: GET /compute/v2.1/servers/4e4c90a0-14de-401e-80d5-fe4bf684d991 HTTP/1.1 Jun 29 08:10:37.873907 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: Accept: application/json Jun 29 08:10:37.873907 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: Accept-Encoding: identity Jun 29 08:10:37.873907 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: Connection: close Jun 29 08:10:37.873907 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: Content-Length: 0 Jun 29 08:10:37.873907 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: Content-Type: application/json Jun 29 08:10:37.873907 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: Host: 10.222.0.43 Jun 29 08:10:37.873907 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: Openstack-System-Scope: None Jun 29 08:10:37.873907 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: User-Agent: python-urllib3/1.26.9 Jun 29 08:10:37.873907 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Auth-Token: gAAAAABivAc4Dw3dL_TQhYQl5Igg98aro7Udj56xbEiFVE6P-s3XIU81t9_uxZaLteFfekv5Hw9_AjoRpURcLw5l3CTAbHLq2DTKi8nbmPHhtb4ZHtMDYVQvp8Qp_4L8IbtnuCb6ruyl7a8sdsxDe_G7IpALZfBEoasd1lTOVJzsuY8CAtUkOKU Jun 29 08:10:37.873907 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Domain-Id: None Jun 29 08:10:37.873907 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Domain-Name: None Jun 29 08:10:37.873907 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Identity-Status: Confirmed Jun 29 08:10:37.873907 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Is-Admin-Project: True Jun 29 08:10:37.873907 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Openstack-Nova-Api-Version: 2.20 Jun 29 08:10:37.873907 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Project-Domain-Id: default Jun 29 08:10:37.873907 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Project-Domain-Name: Default Jun 29 08:10:37.873907 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Project-Id: 4cd09897be9c4642b91dfb53a536e7d1 Jun 29 08:10:37.873907 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1189845647 Jun 29 08:10:37.873907 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Role: member,reader Jun 29 08:10:37.873907 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Roles: member,reader Jun 29 08:10:37.875751 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/4cd09897be9c4642b91dfb53a536e7d1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_4cd09897be9c4642b91dfb53a536e7d1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/4cd09897be9c4642b91dfb53a536e7d1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/4cd09897be9c4642b91dfb53a536e7d1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Jun 29 08:10:37.875751 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1189845647 Jun 29 08:10:37.875751 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Tenant-Id: 4cd09897be9c4642b91dfb53a536e7d1 Jun 29 08:10:37.875751 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1189845647 Jun 29 08:10:37.875751 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-User: tempest-AttachVolumeShelveTestJSON-1189845647-project Jun 29 08:10:37.875751 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-User-Domain-Id: default Jun 29 08:10:37.875751 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-User-Domain-Name: Default Jun 29 08:10:37.875751 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-User-Id: c9065575ed314f6f8f3915bf596911e5 Jun 29 08:10:37.875751 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1189845647-project Jun 29 08:10:37.875751 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: method: > Jun 29 08:10:37.875751 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: exception: Instance 4e4c90a0-14de-401e-80d5-fe4bf684d991 could not be found. Jun 29 08:10:37.875751 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: action_args: {'id': '4e4c90a0-14de-401e-80d5-fe4bf684d991'} Jun 29 08:10:37.876636 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 08:10:37.876636 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:10:37.876636 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 29 08:10:37.876636 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 29 08:10:37.876636 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 29 08:10:37.876636 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 29 08:10:37.876636 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 29 08:10:37.876636 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 29 08:10:37.876636 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 29 08:10:37.876636 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 29 08:10:37.876636 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4e4c90a0-14de-401e-80d5-fe4bf684d991 could not be found. Jun 29 08:10:37.876636 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 29 08:10:37.876636 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 08:10:37.876636 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 29 08:10:37.876636 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:10:37.876636 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 08:10:37.876636 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 08:10:37.876636 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 08:10:37.876636 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 08:10:37.876636 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 08:10:37.878164 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 08:10:37.878164 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 29 08:10:37.878164 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 29 08:10:37.878164 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 29 08:10:37.878164 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 29 08:10:37.878164 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 29 08:10:37.878164 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 29 08:10:37.878164 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4e4c90a0-14de-401e-80d5-fe4bf684d991 could not be found. Jun 29 08:10:37.878164 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 29 08:10:37.878164 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 08:10:37.878164 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 29 08:10:37.878164 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:10:37.878164 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 08:10:37.878164 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 08:10:37.878164 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 08:10:37.878164 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 08:10:37.878164 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4e4c90a0-14de-401e-80d5-fe4bf684d991 could not be found. Jun 29 08:10:37.878164 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 29 08:10:37.879650 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-b7cf055e-b823-4e3a-9496-64ab042516f1 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Returning 404 to user: Instance 4e4c90a0-14de-401e-80d5-fe4bf684d991 could not be found. {{(pid=117890) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 08:10:37.879650 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-b7cf055e-b823-4e3a-9496-64ab042516f1 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] 10.222.0.43 "GET /compute/v2.1/servers/4e4c90a0-14de-401e-80d5-fe4bf684d991" status: 404 len: 111 microversion: 2.20 time: 0.029428 Jun 29 08:10:37.879650 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 423/855] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 29 08:10:37 2022] GET /compute/v2.1/servers/4e4c90a0-14de-401e-80d5-fe4bf684d991 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 29 08:10:37.884464 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-91bf7325-6a86-4aa5-8d9d-ea6519a357fc tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Calling method '.version_select at 0x7f724109d310>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:10:37.902706 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-91bf7325-6a86-4aa5-8d9d-ea6519a357fc tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-514829004" status: 204 len: 0 microversion: 2.20 time: 0.021552 Jun 29 08:10:37.902706 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 433/856] 10.222.0.43 () {60 vars in 1258 bytes} [Wed Jun 29 08:10:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-514829004 => generated 0 bytes in 23 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 29 08:10:40.737577 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-a79991a7-460f-4854-8f10-43b7f38e05f3 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:10:40.738282 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-a79991a7-460f-4854-8f10-43b7f38e05f3 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] [instance: 4e4c90a0-14de-401e-80d5-fe4bf684d991] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:10:40.745629 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-a79991a7-460f-4854-8f10-43b7f38e05f3 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:10:40.746092 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-a79991a7-460f-4854-8f10-43b7f38e05f3 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:10:40.746850 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-a79991a7-460f-4854-8f10-43b7f38e05f3 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:10:40.747282 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-a79991a7-460f-4854-8f10-43b7f38e05f3 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:10:40.768611 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.wsgi [None req-a79991a7-460f-4854-8f10-43b7f38e05f3 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] HTTP exception thrown: Instance 4e4c90a0-14de-401e-80d5-fe4bf684d991 could not be found. Jun 29 08:10:40.770884 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-a79991a7-460f-4854-8f10-43b7f38e05f3 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Request method failure captured: Jun 29 08:10:40.770884 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: request: DELETE /compute/v2.1/servers/4e4c90a0-14de-401e-80d5-fe4bf684d991 HTTP/1.1 Jun 29 08:10:40.770884 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: Accept: application/json Jun 29 08:10:40.770884 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: Accept-Encoding: identity Jun 29 08:10:40.770884 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: Connection: close Jun 29 08:10:40.770884 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: Content-Length: 0 Jun 29 08:10:40.770884 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: Content-Type: application/json Jun 29 08:10:40.770884 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: Host: 10.222.0.43 Jun 29 08:10:40.770884 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: Openstack-System-Scope: None Jun 29 08:10:40.770884 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: User-Agent: python-urllib3/1.26.9 Jun 29 08:10:40.770884 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Auth-Token: gAAAAABivAc4Dw3dL_TQhYQl5Igg98aro7Udj56xbEiFVE6P-s3XIU81t9_uxZaLteFfekv5Hw9_AjoRpURcLw5l3CTAbHLq2DTKi8nbmPHhtb4ZHtMDYVQvp8Qp_4L8IbtnuCb6ruyl7a8sdsxDe_G7IpALZfBEoasd1lTOVJzsuY8CAtUkOKU Jun 29 08:10:40.770884 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Domain-Id: None Jun 29 08:10:40.770884 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Domain-Name: None Jun 29 08:10:40.770884 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Identity-Status: Confirmed Jun 29 08:10:40.770884 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Is-Admin-Project: True Jun 29 08:10:40.770884 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Openstack-Nova-Api-Version: 2.20 Jun 29 08:10:40.770884 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Project-Domain-Id: default Jun 29 08:10:40.770884 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Project-Domain-Name: Default Jun 29 08:10:40.770884 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Project-Id: 4cd09897be9c4642b91dfb53a536e7d1 Jun 29 08:10:40.770884 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1189845647 Jun 29 08:10:40.770884 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Role: member,reader Jun 29 08:10:40.770884 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Roles: member,reader Jun 29 08:10:40.772945 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/4cd09897be9c4642b91dfb53a536e7d1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_4cd09897be9c4642b91dfb53a536e7d1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/4cd09897be9c4642b91dfb53a536e7d1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/4cd09897be9c4642b91dfb53a536e7d1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Jun 29 08:10:40.772945 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1189845647 Jun 29 08:10:40.772945 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Tenant-Id: 4cd09897be9c4642b91dfb53a536e7d1 Jun 29 08:10:40.772945 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1189845647 Jun 29 08:10:40.772945 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-User: tempest-AttachVolumeShelveTestJSON-1189845647-project Jun 29 08:10:40.772945 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-User-Domain-Id: default Jun 29 08:10:40.772945 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-User-Domain-Name: Default Jun 29 08:10:40.772945 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-User-Id: c9065575ed314f6f8f3915bf596911e5 Jun 29 08:10:40.772945 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1189845647-project Jun 29 08:10:40.772945 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: method: > Jun 29 08:10:40.772945 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: exception: Instance 4e4c90a0-14de-401e-80d5-fe4bf684d991 could not be found. Jun 29 08:10:40.772945 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: action_args: {'id': '4e4c90a0-14de-401e-80d5-fe4bf684d991'} Jun 29 08:10:40.773731 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 08:10:40.773731 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:10:40.773731 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 29 08:10:40.773731 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 29 08:10:40.773731 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 29 08:10:40.773731 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 29 08:10:40.773731 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 29 08:10:40.773731 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 29 08:10:40.773731 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 29 08:10:40.773731 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 29 08:10:40.773731 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4e4c90a0-14de-401e-80d5-fe4bf684d991 could not be found. Jun 29 08:10:40.773731 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 29 08:10:40.773731 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 08:10:40.773731 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 29 08:10:40.773731 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:10:40.773731 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 08:10:40.773731 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 08:10:40.773731 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 08:10:40.773731 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 08:10:40.773731 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 08:10:40.775332 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 08:10:40.775332 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 29 08:10:40.775332 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 29 08:10:40.775332 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 29 08:10:40.775332 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 29 08:10:40.775332 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 29 08:10:40.775332 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 29 08:10:40.775332 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 29 08:10:40.775332 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 29 08:10:40.775332 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4e4c90a0-14de-401e-80d5-fe4bf684d991 could not be found. Jun 29 08:10:40.775332 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 29 08:10:40.775332 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 08:10:40.775332 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 29 08:10:40.775332 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:10:40.775332 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 08:10:40.775332 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 08:10:40.775332 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 08:10:40.775332 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 08:10:40.775332 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4e4c90a0-14de-401e-80d5-fe4bf684d991 could not be found. Jun 29 08:10:40.775332 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 29 08:10:40.779631 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-a79991a7-460f-4854-8f10-43b7f38e05f3 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Returning 404 to user: Instance 4e4c90a0-14de-401e-80d5-fe4bf684d991 could not be found. {{(pid=117890) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 08:10:40.779631 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-a79991a7-460f-4854-8f10-43b7f38e05f3 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] 10.222.0.43 "DELETE /compute/v2.1/servers/4e4c90a0-14de-401e-80d5-fe4bf684d991" status: 404 len: 111 microversion: 2.20 time: 0.041850 Jun 29 08:10:40.779631 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 424/857] 10.222.0.43 () {60 vars in 1279 bytes} [Wed Jun 29 08:10:40 2022] DELETE /compute/v2.1/servers/4e4c90a0-14de-401e-80d5-fe4bf684d991 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 29 08:10:40.783657 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-fe873f15-c6be-46ee-b55c-7a0eea77caf5 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:10:40.784356 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-fe873f15-c6be-46ee-b55c-7a0eea77caf5 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] [instance: 4e4c90a0-14de-401e-80d5-fe4bf684d991] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:10:40.794387 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-fe873f15-c6be-46ee-b55c-7a0eea77caf5 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:10:40.795143 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-fe873f15-c6be-46ee-b55c-7a0eea77caf5 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:10:40.797045 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-fe873f15-c6be-46ee-b55c-7a0eea77caf5 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:10:40.797825 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-fe873f15-c6be-46ee-b55c-7a0eea77caf5 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:10:40.815796 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.wsgi [None req-fe873f15-c6be-46ee-b55c-7a0eea77caf5 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] HTTP exception thrown: Instance 4e4c90a0-14de-401e-80d5-fe4bf684d991 could not be found. Jun 29 08:10:40.817902 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-fe873f15-c6be-46ee-b55c-7a0eea77caf5 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Request method failure captured: Jun 29 08:10:40.817902 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: request: GET /compute/v2.1/servers/4e4c90a0-14de-401e-80d5-fe4bf684d991 HTTP/1.1 Jun 29 08:10:40.817902 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: Accept: application/json Jun 29 08:10:40.817902 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: Accept-Encoding: identity Jun 29 08:10:40.817902 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: Connection: close Jun 29 08:10:40.817902 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: Content-Length: 0 Jun 29 08:10:40.817902 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: Content-Type: application/json Jun 29 08:10:40.817902 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: Host: 10.222.0.43 Jun 29 08:10:40.817902 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: Openstack-System-Scope: None Jun 29 08:10:40.817902 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: User-Agent: python-urllib3/1.26.9 Jun 29 08:10:40.817902 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Auth-Token: gAAAAABivAc4Dw3dL_TQhYQl5Igg98aro7Udj56xbEiFVE6P-s3XIU81t9_uxZaLteFfekv5Hw9_AjoRpURcLw5l3CTAbHLq2DTKi8nbmPHhtb4ZHtMDYVQvp8Qp_4L8IbtnuCb6ruyl7a8sdsxDe_G7IpALZfBEoasd1lTOVJzsuY8CAtUkOKU Jun 29 08:10:40.817902 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Domain-Id: None Jun 29 08:10:40.817902 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Domain-Name: None Jun 29 08:10:40.817902 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Identity-Status: Confirmed Jun 29 08:10:40.817902 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Is-Admin-Project: True Jun 29 08:10:40.817902 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Openstack-Nova-Api-Version: 2.20 Jun 29 08:10:40.817902 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Project-Domain-Id: default Jun 29 08:10:40.817902 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Project-Domain-Name: Default Jun 29 08:10:40.817902 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Project-Id: 4cd09897be9c4642b91dfb53a536e7d1 Jun 29 08:10:40.817902 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1189845647 Jun 29 08:10:40.817902 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Role: member,reader Jun 29 08:10:40.817902 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Roles: member,reader Jun 29 08:10:40.819827 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/4cd09897be9c4642b91dfb53a536e7d1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_4cd09897be9c4642b91dfb53a536e7d1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/4cd09897be9c4642b91dfb53a536e7d1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/4cd09897be9c4642b91dfb53a536e7d1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Jun 29 08:10:40.819827 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1189845647 Jun 29 08:10:40.819827 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Tenant-Id: 4cd09897be9c4642b91dfb53a536e7d1 Jun 29 08:10:40.819827 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1189845647 Jun 29 08:10:40.819827 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-User: tempest-AttachVolumeShelveTestJSON-1189845647-project Jun 29 08:10:40.819827 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-User-Domain-Id: default Jun 29 08:10:40.819827 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-User-Domain-Name: Default Jun 29 08:10:40.819827 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-User-Id: c9065575ed314f6f8f3915bf596911e5 Jun 29 08:10:40.819827 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1189845647-project Jun 29 08:10:40.819827 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: method: > Jun 29 08:10:40.819827 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: exception: Instance 4e4c90a0-14de-401e-80d5-fe4bf684d991 could not be found. Jun 29 08:10:40.819827 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: action_args: {'id': '4e4c90a0-14de-401e-80d5-fe4bf684d991'} Jun 29 08:10:40.820726 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 08:10:40.820726 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:10:40.820726 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 29 08:10:40.820726 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 29 08:10:40.820726 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 29 08:10:40.820726 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 29 08:10:40.820726 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 29 08:10:40.820726 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 29 08:10:40.820726 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 29 08:10:40.820726 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 29 08:10:40.820726 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4e4c90a0-14de-401e-80d5-fe4bf684d991 could not be found. Jun 29 08:10:40.820726 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 29 08:10:40.820726 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 08:10:40.820726 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 29 08:10:40.820726 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:10:40.820726 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 08:10:40.820726 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 08:10:40.820726 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 08:10:40.820726 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 08:10:40.820726 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 08:10:40.825463 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 08:10:40.825463 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 29 08:10:40.825463 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 29 08:10:40.825463 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 29 08:10:40.825463 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 29 08:10:40.825463 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 29 08:10:40.825463 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 29 08:10:40.825463 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4e4c90a0-14de-401e-80d5-fe4bf684d991 could not be found. Jun 29 08:10:40.825463 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 29 08:10:40.825463 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 08:10:40.825463 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 29 08:10:40.825463 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:10:40.825463 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 08:10:40.825463 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 08:10:40.825463 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 08:10:40.825463 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 08:10:40.825463 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4e4c90a0-14de-401e-80d5-fe4bf684d991 could not be found. Jun 29 08:10:40.825463 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 29 08:10:40.827230 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-fe873f15-c6be-46ee-b55c-7a0eea77caf5 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Returning 404 to user: Instance 4e4c90a0-14de-401e-80d5-fe4bf684d991 could not be found. {{(pid=117889) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 08:10:40.827230 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-fe873f15-c6be-46ee-b55c-7a0eea77caf5 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] 10.222.0.43 "GET /compute/v2.1/servers/4e4c90a0-14de-401e-80d5-fe4bf684d991" status: 404 len: 111 microversion: 2.20 time: 0.041844 Jun 29 08:10:40.827230 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 434/858] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 29 08:10:40 2022] GET /compute/v2.1/servers/4e4c90a0-14de-401e-80d5-fe4bf684d991 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 29 08:10:42.013036 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-65d22e57-d6c6-4849-89fd-f8a55c3192eb tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:10:42.013816 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-65d22e57-d6c6-4849-89fd-f8a55c3192eb tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] [instance: f99567d1-cadf-40c5-b1dc-f86739b2b16c] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:10:42.023318 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-65d22e57-d6c6-4849-89fd-f8a55c3192eb tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:10:42.023686 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-65d22e57-d6c6-4849-89fd-f8a55c3192eb tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:10:42.024552 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-65d22e57-d6c6-4849-89fd-f8a55c3192eb tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:10:42.025216 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-65d22e57-d6c6-4849-89fd-f8a55c3192eb tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:10:42.047694 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.wsgi [None req-65d22e57-d6c6-4849-89fd-f8a55c3192eb tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] HTTP exception thrown: Instance f99567d1-cadf-40c5-b1dc-f86739b2b16c could not be found. Jun 29 08:10:42.049344 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-65d22e57-d6c6-4849-89fd-f8a55c3192eb tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Request method failure captured: Jun 29 08:10:42.049344 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: request: DELETE /compute/v2.1/servers/f99567d1-cadf-40c5-b1dc-f86739b2b16c HTTP/1.1 Jun 29 08:10:42.049344 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: Accept: application/json Jun 29 08:10:42.049344 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: Accept-Encoding: identity Jun 29 08:10:42.049344 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: Connection: close Jun 29 08:10:42.049344 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: Content-Length: 0 Jun 29 08:10:42.049344 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: Content-Type: application/json Jun 29 08:10:42.049344 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: Host: 10.222.0.43 Jun 29 08:10:42.049344 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: Openstack-System-Scope: None Jun 29 08:10:42.049344 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: User-Agent: python-urllib3/1.26.9 Jun 29 08:10:42.049344 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Auth-Token: gAAAAABivAc4Dw3dL_TQhYQl5Igg98aro7Udj56xbEiFVE6P-s3XIU81t9_uxZaLteFfekv5Hw9_AjoRpURcLw5l3CTAbHLq2DTKi8nbmPHhtb4ZHtMDYVQvp8Qp_4L8IbtnuCb6ruyl7a8sdsxDe_G7IpALZfBEoasd1lTOVJzsuY8CAtUkOKU Jun 29 08:10:42.049344 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Domain-Id: None Jun 29 08:10:42.049344 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Domain-Name: None Jun 29 08:10:42.049344 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Identity-Status: Confirmed Jun 29 08:10:42.049344 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Is-Admin-Project: True Jun 29 08:10:42.049344 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Openstack-Nova-Api-Version: 2.20 Jun 29 08:10:42.049344 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Project-Domain-Id: default Jun 29 08:10:42.049344 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Project-Domain-Name: Default Jun 29 08:10:42.049344 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Project-Id: 4cd09897be9c4642b91dfb53a536e7d1 Jun 29 08:10:42.049344 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1189845647 Jun 29 08:10:42.049344 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Role: member,reader Jun 29 08:10:42.049344 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Roles: member,reader Jun 29 08:10:42.051319 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/4cd09897be9c4642b91dfb53a536e7d1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_4cd09897be9c4642b91dfb53a536e7d1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/4cd09897be9c4642b91dfb53a536e7d1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/4cd09897be9c4642b91dfb53a536e7d1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Jun 29 08:10:42.051319 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1189845647 Jun 29 08:10:42.051319 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Tenant-Id: 4cd09897be9c4642b91dfb53a536e7d1 Jun 29 08:10:42.051319 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1189845647 Jun 29 08:10:42.051319 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-User: tempest-AttachVolumeShelveTestJSON-1189845647-project Jun 29 08:10:42.051319 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-User-Domain-Id: default Jun 29 08:10:42.051319 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-User-Domain-Name: Default Jun 29 08:10:42.051319 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-User-Id: c9065575ed314f6f8f3915bf596911e5 Jun 29 08:10:42.051319 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1189845647-project Jun 29 08:10:42.051319 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: method: > Jun 29 08:10:42.051319 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: exception: Instance f99567d1-cadf-40c5-b1dc-f86739b2b16c could not be found. Jun 29 08:10:42.051319 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: action_args: {'id': 'f99567d1-cadf-40c5-b1dc-f86739b2b16c'} Jun 29 08:10:42.052167 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 08:10:42.052167 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:10:42.052167 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 29 08:10:42.052167 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 29 08:10:42.052167 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 29 08:10:42.052167 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 29 08:10:42.052167 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 29 08:10:42.052167 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 29 08:10:42.052167 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 29 08:10:42.052167 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 29 08:10:42.052167 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f99567d1-cadf-40c5-b1dc-f86739b2b16c could not be found. Jun 29 08:10:42.052167 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 29 08:10:42.052167 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 08:10:42.052167 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 29 08:10:42.052167 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:10:42.052167 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 08:10:42.052167 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 08:10:42.052167 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 08:10:42.052167 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 08:10:42.052167 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 08:10:42.054008 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 08:10:42.054008 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 29 08:10:42.054008 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 29 08:10:42.054008 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 29 08:10:42.054008 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 29 08:10:42.054008 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 29 08:10:42.054008 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 29 08:10:42.054008 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 29 08:10:42.054008 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 29 08:10:42.054008 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f99567d1-cadf-40c5-b1dc-f86739b2b16c could not be found. Jun 29 08:10:42.054008 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 29 08:10:42.054008 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 08:10:42.054008 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 29 08:10:42.054008 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:10:42.054008 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 08:10:42.054008 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 08:10:42.054008 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 08:10:42.054008 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 08:10:42.054008 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f99567d1-cadf-40c5-b1dc-f86739b2b16c could not be found. Jun 29 08:10:42.054008 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 29 08:10:42.055717 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-65d22e57-d6c6-4849-89fd-f8a55c3192eb tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Returning 404 to user: Instance f99567d1-cadf-40c5-b1dc-f86739b2b16c could not be found. {{(pid=117890) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 08:10:42.055717 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-65d22e57-d6c6-4849-89fd-f8a55c3192eb tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] 10.222.0.43 "DELETE /compute/v2.1/servers/f99567d1-cadf-40c5-b1dc-f86739b2b16c" status: 404 len: 111 microversion: 2.20 time: 0.044586 Jun 29 08:10:42.055717 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 425/859] 10.222.0.43 () {60 vars in 1279 bytes} [Wed Jun 29 08:10:42 2022] DELETE /compute/v2.1/servers/f99567d1-cadf-40c5-b1dc-f86739b2b16c => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 29 08:10:42.063303 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-841e0f89-3aee-422a-892d-222ebe4656f2 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:10:42.064302 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-841e0f89-3aee-422a-892d-222ebe4656f2 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] [instance: f99567d1-cadf-40c5-b1dc-f86739b2b16c] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:10:42.072662 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-841e0f89-3aee-422a-892d-222ebe4656f2 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:10:42.073135 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-841e0f89-3aee-422a-892d-222ebe4656f2 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:10:42.073934 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-841e0f89-3aee-422a-892d-222ebe4656f2 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:10:42.074563 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-841e0f89-3aee-422a-892d-222ebe4656f2 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:10:42.096672 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.wsgi [None req-841e0f89-3aee-422a-892d-222ebe4656f2 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] HTTP exception thrown: Instance f99567d1-cadf-40c5-b1dc-f86739b2b16c could not be found. Jun 29 08:10:42.100056 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-841e0f89-3aee-422a-892d-222ebe4656f2 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Request method failure captured: Jun 29 08:10:42.100056 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: request: GET /compute/v2.1/servers/f99567d1-cadf-40c5-b1dc-f86739b2b16c HTTP/1.1 Jun 29 08:10:42.100056 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: Accept: application/json Jun 29 08:10:42.100056 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: Accept-Encoding: identity Jun 29 08:10:42.100056 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: Connection: close Jun 29 08:10:42.100056 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: Content-Length: 0 Jun 29 08:10:42.100056 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: Content-Type: application/json Jun 29 08:10:42.100056 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: Host: 10.222.0.43 Jun 29 08:10:42.100056 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: Openstack-System-Scope: None Jun 29 08:10:42.100056 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: User-Agent: python-urllib3/1.26.9 Jun 29 08:10:42.100056 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Auth-Token: gAAAAABivAc4Dw3dL_TQhYQl5Igg98aro7Udj56xbEiFVE6P-s3XIU81t9_uxZaLteFfekv5Hw9_AjoRpURcLw5l3CTAbHLq2DTKi8nbmPHhtb4ZHtMDYVQvp8Qp_4L8IbtnuCb6ruyl7a8sdsxDe_G7IpALZfBEoasd1lTOVJzsuY8CAtUkOKU Jun 29 08:10:42.100056 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Domain-Id: None Jun 29 08:10:42.100056 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Domain-Name: None Jun 29 08:10:42.100056 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Identity-Status: Confirmed Jun 29 08:10:42.100056 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Is-Admin-Project: True Jun 29 08:10:42.100056 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Openstack-Nova-Api-Version: 2.20 Jun 29 08:10:42.100056 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Project-Domain-Id: default Jun 29 08:10:42.100056 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Project-Domain-Name: Default Jun 29 08:10:42.100056 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Project-Id: 4cd09897be9c4642b91dfb53a536e7d1 Jun 29 08:10:42.100056 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1189845647 Jun 29 08:10:42.100056 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Role: member,reader Jun 29 08:10:42.100056 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Roles: member,reader Jun 29 08:10:42.106104 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/4cd09897be9c4642b91dfb53a536e7d1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_4cd09897be9c4642b91dfb53a536e7d1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/4cd09897be9c4642b91dfb53a536e7d1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/4cd09897be9c4642b91dfb53a536e7d1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Jun 29 08:10:42.106104 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1189845647 Jun 29 08:10:42.106104 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Tenant-Id: 4cd09897be9c4642b91dfb53a536e7d1 Jun 29 08:10:42.106104 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1189845647 Jun 29 08:10:42.106104 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-User: tempest-AttachVolumeShelveTestJSON-1189845647-project Jun 29 08:10:42.106104 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-User-Domain-Id: default Jun 29 08:10:42.106104 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-User-Domain-Name: Default Jun 29 08:10:42.106104 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-User-Id: c9065575ed314f6f8f3915bf596911e5 Jun 29 08:10:42.106104 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1189845647-project Jun 29 08:10:42.106104 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: method: > Jun 29 08:10:42.106104 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: exception: Instance f99567d1-cadf-40c5-b1dc-f86739b2b16c could not be found. Jun 29 08:10:42.106104 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: action_args: {'id': 'f99567d1-cadf-40c5-b1dc-f86739b2b16c'} Jun 29 08:10:42.106895 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 08:10:42.106895 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:10:42.106895 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 29 08:10:42.106895 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 29 08:10:42.106895 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 29 08:10:42.106895 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 29 08:10:42.106895 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 29 08:10:42.106895 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 29 08:10:42.106895 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 29 08:10:42.106895 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 29 08:10:42.106895 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f99567d1-cadf-40c5-b1dc-f86739b2b16c could not be found. Jun 29 08:10:42.106895 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 29 08:10:42.106895 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 08:10:42.106895 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 29 08:10:42.106895 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:10:42.106895 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 08:10:42.106895 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 08:10:42.106895 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 08:10:42.106895 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 08:10:42.106895 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 08:10:42.108861 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 08:10:42.108861 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 29 08:10:42.108861 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 29 08:10:42.108861 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 29 08:10:42.108861 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 29 08:10:42.108861 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 29 08:10:42.108861 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 29 08:10:42.108861 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f99567d1-cadf-40c5-b1dc-f86739b2b16c could not be found. Jun 29 08:10:42.108861 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 29 08:10:42.108861 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 08:10:42.108861 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 29 08:10:42.108861 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:10:42.108861 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 08:10:42.108861 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 08:10:42.108861 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 08:10:42.108861 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 08:10:42.108861 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f99567d1-cadf-40c5-b1dc-f86739b2b16c could not be found. Jun 29 08:10:42.108861 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 29 08:10:42.111099 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-841e0f89-3aee-422a-892d-222ebe4656f2 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] Returning 404 to user: Instance f99567d1-cadf-40c5-b1dc-f86739b2b16c could not be found. {{(pid=117889) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 08:10:42.111099 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-841e0f89-3aee-422a-892d-222ebe4656f2 tempest-AttachVolumeShelveTestJSON-1189845647 tempest-AttachVolumeShelveTestJSON-1189845647-project] 10.222.0.43 "GET /compute/v2.1/servers/f99567d1-cadf-40c5-b1dc-f86739b2b16c" status: 404 len: 111 microversion: 2.20 time: 0.045137 Jun 29 08:10:42.111099 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 435/860] 10.222.0.43 () {60 vars in 1276 bytes} [Wed Jun 29 08:10:42 2022] GET /compute/v2.1/servers/f99567d1-cadf-40c5-b1dc-f86739b2b16c => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 29 08:10:49.645701 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-840c661b-f17b-4cef-b98d-e74cbbaee753 tempest-VolumesTestJSON-1145072219 tempest-VolumesTestJSON-1145072219-project] Calling method '.version_select at 0x7f7245c00e50>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:10:49.710176 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-840c661b-f17b-4cef-b98d-e74cbbaee753 tempest-VolumesTestJSON-1145072219 tempest-VolumesTestJSON-1145072219-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/5a5dc44b-f463-413e-858a-5e9f9edb41de" status: 200 len: 350 microversion: 2.1 time: 0.068050 Jun 29 08:10:49.711680 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 426/861] 10.222.0.43 () {58 vars in 1244 bytes} [Wed Jun 29 08:10:49 2022] GET /compute/v2.1/os-volumes/5a5dc44b-f463-413e-858a-5e9f9edb41de => generated 350 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:10:51.213414 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-c921ceda-52e9-4d35-9017-3f17f49b8678 tempest-VolumesTestJSON-1145072219 tempest-VolumesTestJSON-1145072219-project] Calling method '.version_select at 0x7f7241185b80>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:10:51.273464 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-c921ceda-52e9-4d35-9017-3f17f49b8678 tempest-VolumesTestJSON-1145072219 tempest-VolumesTestJSON-1145072219-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/99599f21-af48-4938-bde3-e0f48adf3f32" status: 200 len: 351 microversion: 2.1 time: 0.063916 Jun 29 08:10:51.274371 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 436/862] 10.222.0.43 () {58 vars in 1244 bytes} [Wed Jun 29 08:10:51 2022] GET /compute/v2.1/os-volumes/99599f21-af48-4938-bde3-e0f48adf3f32 => generated 351 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:10:52.661026 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-07c3293f-e81b-4a79-a4b4-6dc7a249509a tempest-VolumesTestJSON-1145072219 tempest-VolumesTestJSON-1145072219-project] Calling method '.version_select at 0x7f724126b550>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:10:52.674292 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG dbcounter [-] [117890] Writing DB stats nova_api:SELECT=27 {{(pid=117890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:10:52.676552 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG dbcounter [-] [117890] Writing DB stats nova_cell1:SELECT=48 {{(pid=117890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:10:52.744738 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-07c3293f-e81b-4a79-a4b4-6dc7a249509a tempest-VolumesTestJSON-1145072219 tempest-VolumesTestJSON-1145072219-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/3d26030e-4030-49d4-bdbe-2edab76cd92b" status: 200 len: 351 microversion: 2.1 time: 0.087605 Jun 29 08:10:52.745937 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 427/863] 10.222.0.43 () {58 vars in 1244 bytes} [Wed Jun 29 08:10:52 2022] GET /compute/v2.1/os-volumes/3d26030e-4030-49d4-bdbe-2edab76cd92b => generated 351 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:10:52.755135 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_api:SELECT=34,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:10:52.756547 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_cell1:SELECT=79,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:10:52.761422 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-31aed4f1-576d-4d92-826e-2e0f277d768f tempest-VolumesTestJSON-1145072219 tempest-VolumesTestJSON-1145072219-project] Calling method '.version_select at 0x7f724109d550>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:10:52.869386 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-31aed4f1-576d-4d92-826e-2e0f277d768f tempest-VolumesTestJSON-1145072219 tempest-VolumesTestJSON-1145072219-project] 10.222.0.43 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.114971 Jun 29 08:10:52.870301 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 437/864] 10.222.0.43 () {58 vars in 1133 bytes} [Wed Jun 29 08:10:52 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:10:52.884004 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-fd647afa-10d7-4aa5-903b-1f33225c5c41 tempest-VolumesTestJSON-1145072219 tempest-VolumesTestJSON-1145072219-project] Calling method '.version_select at 0x7f7245c00af0>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:10:52.980465 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-fd647afa-10d7-4aa5-903b-1f33225c5c41 tempest-VolumesTestJSON-1145072219 tempest-VolumesTestJSON-1145072219-project] 10.222.0.43 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.100080 Jun 29 08:10:52.980999 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 428/865] 10.222.0.43 () {58 vars in 1148 bytes} [Wed Jun 29 08:10:52 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:10:52.994027 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-c26ca7ba-dc17-482a-8dfa-6ceb1dce2c0d tempest-VolumesTestJSON-1145072219 tempest-VolumesTestJSON-1145072219-project] Calling method '.version_select at 0x7f7241161e50>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:10:53.127122 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-c26ca7ba-dc17-482a-8dfa-6ceb1dce2c0d tempest-VolumesTestJSON-1145072219 tempest-VolumesTestJSON-1145072219-project] 10.222.0.43 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.136948 Jun 29 08:10:53.129067 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 438/866] 10.222.0.43 () {58 vars in 1133 bytes} [Wed Jun 29 08:10:52 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:10:53.140753 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-b644c7e7-7bb2-456e-accc-37571f6ca993 tempest-VolumesTestJSON-1145072219 tempest-VolumesTestJSON-1145072219-project] Calling method '.version_select at 0x7f7241237160>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:10:53.262109 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-b644c7e7-7bb2-456e-accc-37571f6ca993 tempest-VolumesTestJSON-1145072219 tempest-VolumesTestJSON-1145072219-project] 10.222.0.43 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.125947 Jun 29 08:10:53.263316 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 429/867] 10.222.0.43 () {58 vars in 1166 bytes} [Wed Jun 29 08:10:53 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:10:53.275762 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-56cb22a2-9a31-494b-baf5-457e1daad84d tempest-VolumesTestJSON-1145072219 tempest-VolumesTestJSON-1145072219-project] Calling method '.version_select at 0x7f7241169670>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:10:53.381718 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-56cb22a2-9a31-494b-baf5-457e1daad84d tempest-VolumesTestJSON-1145072219 tempest-VolumesTestJSON-1145072219-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.109755 Jun 29 08:10:53.393030 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 439/868] 10.222.0.43 () {58 vars in 1169 bytes} [Wed Jun 29 08:10:53 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 29 08:10:53.400258 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-fe9a71b0-eda6-4f41-8c43-4693bb0a18c6 tempest-VolumesTestJSON-1145072219 tempest-VolumesTestJSON-1145072219-project] Calling method '.version_select at 0x7f724126b700>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:10:53.543033 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-fe9a71b0-eda6-4f41-8c43-4693bb0a18c6 tempest-VolumesTestJSON-1145072219 tempest-VolumesTestJSON-1145072219-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.147602 Jun 29 08:10:53.545196 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 430/869] 10.222.0.43 () {58 vars in 1154 bytes} [Wed Jun 29 08:10:53 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:10:53.557554 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-79a6e9c9-832d-4aa8-94f3-aa93b2ea4cf0 tempest-VolumesTestJSON-1145072219 tempest-VolumesTestJSON-1145072219-project] Calling method '.version_select at 0x7f724109daf0>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:10:53.652411 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-79a6e9c9-832d-4aa8-94f3-aa93b2ea4cf0 tempest-VolumesTestJSON-1145072219 tempest-VolumesTestJSON-1145072219-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.098670 Jun 29 08:10:53.653019 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 440/870] 10.222.0.43 () {58 vars in 1187 bytes} [Wed Jun 29 08:10:53 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:10:53.667480 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-a4b9d19f-6af4-4caf-8172-297e5eddb618 tempest-VolumesTestJSON-1145072219 tempest-VolumesTestJSON-1145072219-project] Calling method '.version_select at 0x7f724126b1f0>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:10:53.763203 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-a4b9d19f-6af4-4caf-8172-297e5eddb618 tempest-VolumesTestJSON-1145072219 tempest-VolumesTestJSON-1145072219-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.100276 Jun 29 08:10:53.764303 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 431/871] 10.222.0.43 () {58 vars in 1154 bytes} [Wed Jun 29 08:10:53 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 08:10:57.199870 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-82f95ae3-7e11-4165-a4aa-ebdd99e3d543 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:10:57.201404 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-82f95ae3-7e11-4165-a4aa-ebdd99e3d543 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] [instance: 7c7721f2-e567-4e6f-aefd-d852fa3fe37a] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:10:57.210136 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-82f95ae3-7e11-4165-a4aa-ebdd99e3d543 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:10:57.210926 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-82f95ae3-7e11-4165-a4aa-ebdd99e3d543 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:10:57.211932 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-82f95ae3-7e11-4165-a4aa-ebdd99e3d543 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:10:57.212373 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-82f95ae3-7e11-4165-a4aa-ebdd99e3d543 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:10:57.239434 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-82f95ae3-7e11-4165-a4aa-ebdd99e3d543 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] 10.222.0.43 "GET /compute/v2.1/servers/7c7721f2-e567-4e6f-aefd-d852fa3fe37a/ips" status: 200 len: 149 microversion: 2.1 time: 0.043656 Jun 29 08:10:57.240121 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 441/872] 10.222.0.43 () {58 vars in 1247 bytes} [Wed Jun 29 08:10:57 2022] GET /compute/v2.1/servers/7c7721f2-e567-4e6f-aefd-d852fa3fe37a/ips => generated 149 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:10:57.253269 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-f550f11d-aeab-48a7-b349-5ea196f11d00 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3887aaec-216a-4572-a982-bf3a1b30cd1d"}} {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:10:57.254361 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-f550f11d-aeab-48a7-b349-5ea196f11d00 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] [instance: 7c7721f2-e567-4e6f-aefd-d852fa3fe37a] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:10:57.262264 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-f550f11d-aeab-48a7-b349-5ea196f11d00 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:10:57.263048 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-f550f11d-aeab-48a7-b349-5ea196f11d00 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:10:57.263887 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-f550f11d-aeab-48a7-b349-5ea196f11d00 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:10:57.264322 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-f550f11d-aeab-48a7-b349-5ea196f11d00 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:10:57.368019 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.wsgi [None req-f550f11d-aeab-48a7-b349-5ea196f11d00 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] HTTP exception thrown: Invalid volume: volume 3887aaec-216a-4572-a982-bf3a1b30cd1d is already attached to instances: 57b6d980-40de-4505-a591-20b54645d37c Jun 29 08:10:57.369933 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-f550f11d-aeab-48a7-b349-5ea196f11d00 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Request method failure captured: Jun 29 08:10:57.369933 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: request: POST /compute/v2.1/servers/7c7721f2-e567-4e6f-aefd-d852fa3fe37a/os-volume_attachments HTTP/1.1 Jun 29 08:10:57.369933 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: Accept: application/json Jun 29 08:10:57.369933 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: Accept-Encoding: identity Jun 29 08:10:57.369933 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: Connection: close Jun 29 08:10:57.369933 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: Content-Length: 74 Jun 29 08:10:57.369933 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: Content-Type: application/json Jun 29 08:10:57.369933 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: Host: 10.222.0.43 Jun 29 08:10:57.369933 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: Openstack-System-Scope: None Jun 29 08:10:57.369933 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: User-Agent: python-urllib3/1.26.9 Jun 29 08:10:57.369933 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Auth-Token: gAAAAABivAiYnWOqjiwHcE1PCPUmCrIvEMkbVX7lWZxh9jPOZ_GtAOja07fGzXFEXqZ7Ky0xacgV6SGsTaq5tzX8bh-ZG0acOi-203kWLHdiaJ2wslMtHKMClYhsYgyOgs9fcpZ5v5SN8dlG-3pGiAd5z4Hj9kmL7TX1CMp1QfZwI7CaxfijbC4 Jun 29 08:10:57.369933 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Domain-Id: None Jun 29 08:10:57.369933 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Domain-Name: None Jun 29 08:10:57.369933 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Identity-Status: Confirmed Jun 29 08:10:57.369933 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Is-Admin-Project: True Jun 29 08:10:57.369933 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Project-Domain-Id: default Jun 29 08:10:57.369933 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Project-Domain-Name: Default Jun 29 08:10:57.369933 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Project-Id: a4df15f6a6dd45dab12d0b724076a23e Jun 29 08:10:57.369933 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Project-Name: tempest-AttachVolumeNegativeTest-471433960 Jun 29 08:10:57.369933 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Role: member,reader Jun 29 08:10:57.369933 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Roles: member,reader Jun 29 08:10:57.371448 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a4df15f6a6dd45dab12d0b724076a23e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_a4df15f6a6dd45dab12d0b724076a23e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a4df15f6a6dd45dab12d0b724076a23e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/a4df15f6a6dd45dab12d0b724076a23e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Jun 29 08:10:57.371448 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Tenant: tempest-AttachVolumeNegativeTest-471433960 Jun 29 08:10:57.371448 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Tenant-Id: a4df15f6a6dd45dab12d0b724076a23e Jun 29 08:10:57.371448 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-471433960 Jun 29 08:10:57.371448 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-User: tempest-AttachVolumeNegativeTest-471433960-project Jun 29 08:10:57.371448 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-User-Domain-Id: default Jun 29 08:10:57.371448 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-User-Domain-Name: Default Jun 29 08:10:57.371448 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-User-Id: 4873db0f2fbf4a77a617f2102a5ccfae Jun 29 08:10:57.371448 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-User-Name: tempest-AttachVolumeNegativeTest-471433960-project Jun 29 08:10:57.371448 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: Jun 29 08:10:57.371448 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: {"volumeAttachment": {"volumeId": "3887aaec-216a-4572-a982-bf3a1b30cd1d"}} Jun 29 08:10:57.371448 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: method: > Jun 29 08:10:57.372560 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: exception: Invalid volume: volume 3887aaec-216a-4572-a982-bf3a1b30cd1d is already attached to instances: 57b6d980-40de-4505-a591-20b54645d37c Jun 29 08:10:57.372560 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: action_args: {'server_id': '7c7721f2-e567-4e6f-aefd-d852fa3fe37a', 'body': {'volumeAttachment': {'volumeId': '3887aaec-216a-4572-a982-bf3a1b30cd1d'}}} Jun 29 08:10:57.372560 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 08:10:57.372560 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:10:57.372560 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 29 08:10:57.372560 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 29 08:10:57.372560 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 29 08:10:57.372560 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 29 08:10:57.372560 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 29 08:10:57.372560 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 29 08:10:57.372560 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 29 08:10:57.372560 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 29 08:10:57.372560 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 29 08:10:57.372560 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 29 08:10:57.372560 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 3887aaec-216a-4572-a982-bf3a1b30cd1d is already attached to instances: 57b6d980-40de-4505-a591-20b54645d37c Jun 29 08:10:57.372560 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 29 08:10:57.372560 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 08:10:57.372560 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 29 08:10:57.372560 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:10:57.374090 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 08:10:57.374090 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 08:10:57.374090 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 08:10:57.374090 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 08:10:57.374090 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 08:10:57.374090 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 08:10:57.374090 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 29 08:10:57.374090 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 29 08:10:57.374090 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 29 08:10:57.374090 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 29 08:10:57.374090 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 29 08:10:57.374090 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 29 08:10:57.374090 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 29 08:10:57.374090 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 29 08:10:57.374090 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 3887aaec-216a-4572-a982-bf3a1b30cd1d is already attached to instances: 57b6d980-40de-4505-a591-20b54645d37c Jun 29 08:10:57.374090 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 29 08:10:57.374090 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 08:10:57.374090 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 29 08:10:57.374090 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:10:57.374090 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 08:10:57.375897 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 08:10:57.375897 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 08:10:57.375897 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 08:10:57.375897 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 3887aaec-216a-4572-a982-bf3a1b30cd1d is already attached to instances: 57b6d980-40de-4505-a591-20b54645d37c Jun 29 08:10:57.375897 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 29 08:10:57.375897 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-f550f11d-aeab-48a7-b349-5ea196f11d00 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Returning 400 to user: Invalid volume: volume 3887aaec-216a-4572-a982-bf3a1b30cd1d is already attached to instances: 57b6d980-40de-4505-a591-20b54645d37c {{(pid=117890) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 08:10:57.375897 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-f550f11d-aeab-48a7-b349-5ea196f11d00 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] 10.222.0.43 "POST /compute/v2.1/servers/7c7721f2-e567-4e6f-aefd-d852fa3fe37a/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.123945 Jun 29 08:10:57.380471 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-36463347-a48d-499d-9db1-eef3ddf1d07f tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:10:57.381021 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-36463347-a48d-499d-9db1-eef3ddf1d07f tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] [instance: 7c7721f2-e567-4e6f-aefd-d852fa3fe37a] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:10:57.387571 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-36463347-a48d-499d-9db1-eef3ddf1d07f tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:10:57.388026 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-36463347-a48d-499d-9db1-eef3ddf1d07f tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:10:57.388809 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-36463347-a48d-499d-9db1-eef3ddf1d07f tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:10:57.389271 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-36463347-a48d-499d-9db1-eef3ddf1d07f tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:10:57.392358 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 432/873] 10.222.0.43 () {60 vars in 1322 bytes} [Wed Jun 29 08:10:57 2022] POST /compute/v2.1/servers/7c7721f2-e567-4e6f-aefd-d852fa3fe37a/os-volume_attachments => generated 174 bytes in 137 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 29 08:10:57.417023 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-36463347-a48d-499d-9db1-eef3ddf1d07f tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] [instance: 7c7721f2-e567-4e6f-aefd-d852fa3fe37a] Going to try to terminate instance {{(pid=117889) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 29 08:10:57.510804 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-36463347-a48d-499d-9db1-eef3ddf1d07f tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] 10.222.0.43 "DELETE /compute/v2.1/servers/7c7721f2-e567-4e6f-aefd-d852fa3fe37a" status: 204 len: 0 microversion: 2.1 time: 0.134295 Jun 29 08:10:57.511461 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 442/874] 10.222.0.43 () {58 vars in 1238 bytes} [Wed Jun 29 08:10:57 2022] DELETE /compute/v2.1/servers/7c7721f2-e567-4e6f-aefd-d852fa3fe37a => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 29 08:10:57.520700 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-76cc9af0-e429-4169-8d4d-9f70b3879bca tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:10:57.521590 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-76cc9af0-e429-4169-8d4d-9f70b3879bca tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] [instance: 7c7721f2-e567-4e6f-aefd-d852fa3fe37a] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:10:57.528149 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-76cc9af0-e429-4169-8d4d-9f70b3879bca tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:10:57.528594 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-76cc9af0-e429-4169-8d4d-9f70b3879bca tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:10:57.529395 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-76cc9af0-e429-4169-8d4d-9f70b3879bca tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:10:57.529834 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-76cc9af0-e429-4169-8d4d-9f70b3879bca tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:10:57.667471 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-76cc9af0-e429-4169-8d4d-9f70b3879bca tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4873db0f2fbf4a77a617f2102a5ccfae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4df15f6a6dd45dab12d0b724076a23e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:10:57.675002 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-76cc9af0-e429-4169-8d4d-9f70b3879bca tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] 10.222.0.43 "GET /compute/v2.1/servers/7c7721f2-e567-4e6f-aefd-d852fa3fe37a" status: 200 len: 1682 microversion: 2.1 time: 0.158875 Jun 29 08:10:57.676028 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 433/875] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:10:57 2022] GET /compute/v2.1/servers/7c7721f2-e567-4e6f-aefd-d852fa3fe37a => generated 1682 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:10:58.695722 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-46c1ce2b-9328-451c-b075-6e9ec5759dc5 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:10:58.696457 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-46c1ce2b-9328-451c-b075-6e9ec5759dc5 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] [instance: 7c7721f2-e567-4e6f-aefd-d852fa3fe37a] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:10:58.703862 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-46c1ce2b-9328-451c-b075-6e9ec5759dc5 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:10:58.704695 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-46c1ce2b-9328-451c-b075-6e9ec5759dc5 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:10:58.705683 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-46c1ce2b-9328-451c-b075-6e9ec5759dc5 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:10:58.706524 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-46c1ce2b-9328-451c-b075-6e9ec5759dc5 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:10:58.888782 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-46c1ce2b-9328-451c-b075-6e9ec5759dc5 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4873db0f2fbf4a77a617f2102a5ccfae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4df15f6a6dd45dab12d0b724076a23e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:10:58.899313 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-46c1ce2b-9328-451c-b075-6e9ec5759dc5 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] 10.222.0.43 "GET /compute/v2.1/servers/7c7721f2-e567-4e6f-aefd-d852fa3fe37a" status: 200 len: 1682 microversion: 2.1 time: 0.209126 Jun 29 08:10:58.899968 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 443/876] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:10:58 2022] GET /compute/v2.1/servers/7c7721f2-e567-4e6f-aefd-d852fa3fe37a => generated 1682 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:10:59.918276 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-8d81bbcf-7ac6-41c0-b400-af0e870d7c6d tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:10:59.921481 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-8d81bbcf-7ac6-41c0-b400-af0e870d7c6d tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] [instance: 7c7721f2-e567-4e6f-aefd-d852fa3fe37a] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:10:59.932037 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-8d81bbcf-7ac6-41c0-b400-af0e870d7c6d tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:10:59.932771 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-8d81bbcf-7ac6-41c0-b400-af0e870d7c6d tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:10:59.933597 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-8d81bbcf-7ac6-41c0-b400-af0e870d7c6d tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:10:59.934046 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-8d81bbcf-7ac6-41c0-b400-af0e870d7c6d tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:11:00.007190 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-8d81bbcf-7ac6-41c0-b400-af0e870d7c6d tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4873db0f2fbf4a77a617f2102a5ccfae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4df15f6a6dd45dab12d0b724076a23e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:11:00.017349 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-8d81bbcf-7ac6-41c0-b400-af0e870d7c6d tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] 10.222.0.43 "GET /compute/v2.1/servers/7c7721f2-e567-4e6f-aefd-d852fa3fe37a" status: 200 len: 1614 microversion: 2.1 time: 0.104544 Jun 29 08:11:00.018280 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 434/877] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:10:59 2022] GET /compute/v2.1/servers/7c7721f2-e567-4e6f-aefd-d852fa3fe37a => generated 1614 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 08:11:00.052421 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [req-1fd67a11-c683-4359-ac60-31b35f836aa5 req-ecbb6121-2c04-4224-b95d-9cc4d1c20ccb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c7721f2-e567-4e6f-aefd-d852fa3fe37a", "name": "network-vif-deleted", "tag": "4d314f56-e850-4f57-8290-c2635e548696"}]} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:11:00.063260 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-1fd67a11-c683-4359-ac60-31b35f836aa5 req-ecbb6121-2c04-4224-b95d-9cc4d1c20ccb service nova] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:11:00.074899 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-1fd67a11-c683-4359-ac60-31b35f836aa5 req-ecbb6121-2c04-4224-b95d-9cc4d1c20ccb service nova] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:11:00.093418 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.compute.server_external_events [req-1fd67a11-c683-4359-ac60-31b35f836aa5 req-ecbb6121-2c04-4224-b95d-9cc4d1c20ccb service nova] Creating event network-vif-deleted:4d314f56-e850-4f57-8290-c2635e548696 for instance 7c7721f2-e567-4e6f-aefd-d852fa3fe37a on hv-cinder-76810 Jun 29 08:11:00.098894 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [req-1fd67a11-c683-4359-ac60-31b35f836aa5 req-ecbb6121-2c04-4224-b95d-9cc4d1c20ccb service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050729 Jun 29 08:11:00.100643 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 444/878] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jun 29 08:11:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:11:01.043989 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-55b11a2c-5537-49b9-a4ad-8139d9474fb3 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:11:01.044858 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-55b11a2c-5537-49b9-a4ad-8139d9474fb3 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] [instance: 7c7721f2-e567-4e6f-aefd-d852fa3fe37a] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:11:01.053676 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-55b11a2c-5537-49b9-a4ad-8139d9474fb3 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:11:01.054137 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-55b11a2c-5537-49b9-a4ad-8139d9474fb3 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:11:01.055044 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-55b11a2c-5537-49b9-a4ad-8139d9474fb3 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:11:01.058194 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-55b11a2c-5537-49b9-a4ad-8139d9474fb3 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:11:01.081300 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.wsgi [None req-55b11a2c-5537-49b9-a4ad-8139d9474fb3 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] HTTP exception thrown: Instance 7c7721f2-e567-4e6f-aefd-d852fa3fe37a could not be found. Jun 29 08:11:01.083076 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-55b11a2c-5537-49b9-a4ad-8139d9474fb3 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Request method failure captured: Jun 29 08:11:01.083076 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: request: GET /compute/v2.1/servers/7c7721f2-e567-4e6f-aefd-d852fa3fe37a HTTP/1.1 Jun 29 08:11:01.083076 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: Accept: application/json Jun 29 08:11:01.083076 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: Accept-Encoding: identity Jun 29 08:11:01.083076 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: Connection: close Jun 29 08:11:01.083076 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: Content-Length: 0 Jun 29 08:11:01.083076 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: Content-Type: application/json Jun 29 08:11:01.083076 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: Host: 10.222.0.43 Jun 29 08:11:01.083076 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: Openstack-System-Scope: None Jun 29 08:11:01.083076 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: User-Agent: python-urllib3/1.26.9 Jun 29 08:11:01.083076 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Auth-Token: gAAAAABivAiYnWOqjiwHcE1PCPUmCrIvEMkbVX7lWZxh9jPOZ_GtAOja07fGzXFEXqZ7Ky0xacgV6SGsTaq5tzX8bh-ZG0acOi-203kWLHdiaJ2wslMtHKMClYhsYgyOgs9fcpZ5v5SN8dlG-3pGiAd5z4Hj9kmL7TX1CMp1QfZwI7CaxfijbC4 Jun 29 08:11:01.083076 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Domain-Id: None Jun 29 08:11:01.083076 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Domain-Name: None Jun 29 08:11:01.083076 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Identity-Status: Confirmed Jun 29 08:11:01.083076 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Is-Admin-Project: True Jun 29 08:11:01.083076 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Project-Domain-Id: default Jun 29 08:11:01.083076 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Project-Domain-Name: Default Jun 29 08:11:01.083076 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Project-Id: a4df15f6a6dd45dab12d0b724076a23e Jun 29 08:11:01.083076 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Project-Name: tempest-AttachVolumeNegativeTest-471433960 Jun 29 08:11:01.083076 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Role: member,reader Jun 29 08:11:01.083076 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Roles: member,reader Jun 29 08:11:01.084721 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a4df15f6a6dd45dab12d0b724076a23e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_a4df15f6a6dd45dab12d0b724076a23e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a4df15f6a6dd45dab12d0b724076a23e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/a4df15f6a6dd45dab12d0b724076a23e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Jun 29 08:11:01.084721 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Tenant: tempest-AttachVolumeNegativeTest-471433960 Jun 29 08:11:01.084721 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Tenant-Id: a4df15f6a6dd45dab12d0b724076a23e Jun 29 08:11:01.084721 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-471433960 Jun 29 08:11:01.084721 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-User: tempest-AttachVolumeNegativeTest-471433960-project Jun 29 08:11:01.084721 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-User-Domain-Id: default Jun 29 08:11:01.084721 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-User-Domain-Name: Default Jun 29 08:11:01.084721 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-User-Id: 4873db0f2fbf4a77a617f2102a5ccfae Jun 29 08:11:01.084721 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-User-Name: tempest-AttachVolumeNegativeTest-471433960-project Jun 29 08:11:01.084721 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: method: > Jun 29 08:11:01.084721 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: exception: Instance 7c7721f2-e567-4e6f-aefd-d852fa3fe37a could not be found. Jun 29 08:11:01.084721 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: action_args: {'id': '7c7721f2-e567-4e6f-aefd-d852fa3fe37a'} Jun 29 08:11:01.085675 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 08:11:01.085675 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:11:01.085675 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 29 08:11:01.085675 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 29 08:11:01.085675 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 29 08:11:01.085675 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 29 08:11:01.085675 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 29 08:11:01.085675 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 29 08:11:01.085675 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 29 08:11:01.085675 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 29 08:11:01.085675 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7c7721f2-e567-4e6f-aefd-d852fa3fe37a could not be found. Jun 29 08:11:01.085675 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 29 08:11:01.085675 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 08:11:01.085675 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 29 08:11:01.085675 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:11:01.085675 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 08:11:01.085675 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 08:11:01.085675 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 08:11:01.085675 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 08:11:01.085675 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 08:11:01.087160 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 08:11:01.087160 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 29 08:11:01.087160 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 29 08:11:01.087160 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 29 08:11:01.087160 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 29 08:11:01.087160 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 29 08:11:01.087160 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 29 08:11:01.087160 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7c7721f2-e567-4e6f-aefd-d852fa3fe37a could not be found. Jun 29 08:11:01.087160 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 29 08:11:01.087160 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 08:11:01.087160 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 29 08:11:01.087160 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:11:01.087160 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 08:11:01.087160 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 08:11:01.087160 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 08:11:01.087160 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 08:11:01.087160 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7c7721f2-e567-4e6f-aefd-d852fa3fe37a could not be found. Jun 29 08:11:01.087160 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 29 08:11:01.099203 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-55b11a2c-5537-49b9-a4ad-8139d9474fb3 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Returning 404 to user: Instance 7c7721f2-e567-4e6f-aefd-d852fa3fe37a could not be found. {{(pid=117890) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 08:11:01.100085 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-55b11a2c-5537-49b9-a4ad-8139d9474fb3 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] 10.222.0.43 "GET /compute/v2.1/servers/7c7721f2-e567-4e6f-aefd-d852fa3fe37a" status: 404 len: 111 microversion: 2.1 time: 0.060059 Jun 29 08:11:01.100664 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 435/879] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:11:01 2022] GET /compute/v2.1/servers/7c7721f2-e567-4e6f-aefd-d852fa3fe37a => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 29 08:11:01.118513 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-fb0f14fd-b23d-46f5-80d1-4a2b4eecc5dc tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Calling method '.version_select at 0x7f724109d160>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:11:01.146781 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-fb0f14fd-b23d-46f5-80d1-4a2b4eecc5dc tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1557715134" status: 202 len: 0 microversion: 2.1 time: 0.040652 Jun 29 08:11:01.148951 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 445/880] 10.222.0.43 () {58 vars in 1220 bytes} [Wed Jun 29 08:11:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1557715134 => generated 0 bytes in 44 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 29 08:11:02.070482 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-80822c44-b3e7-46b3-9c78-0ec06598f8f0 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:11:02.071062 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-80822c44-b3e7-46b3-9c78-0ec06598f8f0 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] [instance: 57b6d980-40de-4505-a591-20b54645d37c] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:11:02.077922 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-80822c44-b3e7-46b3-9c78-0ec06598f8f0 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:11:02.078568 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-80822c44-b3e7-46b3-9c78-0ec06598f8f0 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:11:02.079345 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-80822c44-b3e7-46b3-9c78-0ec06598f8f0 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:11:02.079943 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-80822c44-b3e7-46b3-9c78-0ec06598f8f0 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:11:02.179213 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.objects.instance [None req-80822c44-b3e7-46b3-9c78-0ec06598f8f0 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lazy-loading 'services' on Instance uuid 57b6d980-40de-4505-a591-20b54645d37c {{(pid=117890) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 29 08:11:02.263738 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-80822c44-b3e7-46b3-9c78-0ec06598f8f0 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] 10.222.0.43 "DELETE /compute/v2.1/servers/57b6d980-40de-4505-a591-20b54645d37c/os-volume_attachments/3887aaec-216a-4572-a982-bf3a1b30cd1d" status: 202 len: 0 microversion: 2.1 time: 0.197267 Jun 29 08:11:02.269744 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 436/881] 10.222.0.43 () {58 vars in 1415 bytes} [Wed Jun 29 08:11:02 2022] DELETE /compute/v2.1/servers/57b6d980-40de-4505-a591-20b54645d37c/os-volume_attachments/3887aaec-216a-4572-a982-bf3a1b30cd1d => generated 0 bytes in 204 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 29 08:11:02.274500 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-f6b60c5e-2ad5-46bb-8570-d1f816879a89 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:11:02.275569 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-f6b60c5e-2ad5-46bb-8570-d1f816879a89 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] [instance: 57b6d980-40de-4505-a591-20b54645d37c] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:11:02.282980 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-f6b60c5e-2ad5-46bb-8570-d1f816879a89 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:11:02.283855 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-f6b60c5e-2ad5-46bb-8570-d1f816879a89 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:11:02.284290 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-f6b60c5e-2ad5-46bb-8570-d1f816879a89 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:11:02.284686 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-f6b60c5e-2ad5-46bb-8570-d1f816879a89 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:11:02.320469 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-f6b60c5e-2ad5-46bb-8570-d1f816879a89 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] 10.222.0.43 "GET /compute/v2.1/servers/57b6d980-40de-4505-a591-20b54645d37c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049855 Jun 29 08:11:02.321078 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 446/882] 10.222.0.43 () {58 vars in 1301 bytes} [Wed Jun 29 08:11:02 2022] GET /compute/v2.1/servers/57b6d980-40de-4505-a591-20b54645d37c/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 29 08:11:03.334310 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-f782d686-e6c4-4c72-837f-673bdd26c03a tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:11:03.335377 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-f782d686-e6c4-4c72-837f-673bdd26c03a tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] [instance: 57b6d980-40de-4505-a591-20b54645d37c] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:11:03.341655 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-f782d686-e6c4-4c72-837f-673bdd26c03a tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:11:03.342104 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-f782d686-e6c4-4c72-837f-673bdd26c03a tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:11:03.343598 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-f782d686-e6c4-4c72-837f-673bdd26c03a tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:11:03.344044 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-f782d686-e6c4-4c72-837f-673bdd26c03a tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:11:03.372764 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-f782d686-e6c4-4c72-837f-673bdd26c03a tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] 10.222.0.43 "GET /compute/v2.1/servers/57b6d980-40de-4505-a591-20b54645d37c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043561 Jun 29 08:11:03.373540 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 437/883] 10.222.0.43 () {58 vars in 1301 bytes} [Wed Jun 29 08:11:03 2022] GET /compute/v2.1/servers/57b6d980-40de-4505-a591-20b54645d37c/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 29 08:11:03.442246 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-c2ba40d6-f17a-440d-b1b0-bccd9c3eecaa tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:11:03.442763 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-c2ba40d6-f17a-440d-b1b0-bccd9c3eecaa tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] [instance: 57b6d980-40de-4505-a591-20b54645d37c] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:11:03.449494 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c2ba40d6-f17a-440d-b1b0-bccd9c3eecaa tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:11:03.449941 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c2ba40d6-f17a-440d-b1b0-bccd9c3eecaa tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:11:03.450713 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c2ba40d6-f17a-440d-b1b0-bccd9c3eecaa tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:11:03.451143 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c2ba40d6-f17a-440d-b1b0-bccd9c3eecaa tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:11:03.477268 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-c2ba40d6-f17a-440d-b1b0-bccd9c3eecaa tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] [instance: 57b6d980-40de-4505-a591-20b54645d37c] Going to try to terminate instance {{(pid=117889) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 29 08:11:03.570302 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-c2ba40d6-f17a-440d-b1b0-bccd9c3eecaa tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] 10.222.0.43 "DELETE /compute/v2.1/servers/57b6d980-40de-4505-a591-20b54645d37c" status: 204 len: 0 microversion: 2.1 time: 0.134241 Jun 29 08:11:03.574416 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 447/884] 10.222.0.43 () {58 vars in 1238 bytes} [Wed Jun 29 08:11:03 2022] DELETE /compute/v2.1/servers/57b6d980-40de-4505-a591-20b54645d37c => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 29 08:11:03.580397 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-e8851720-1729-412b-9f05-0096f17f4948 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:11:03.581117 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-e8851720-1729-412b-9f05-0096f17f4948 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] [instance: 57b6d980-40de-4505-a591-20b54645d37c] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:11:03.587673 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-e8851720-1729-412b-9f05-0096f17f4948 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:11:03.588124 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-e8851720-1729-412b-9f05-0096f17f4948 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:11:03.588901 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-e8851720-1729-412b-9f05-0096f17f4948 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:11:03.589381 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-e8851720-1729-412b-9f05-0096f17f4948 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:11:03.726272 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-e8851720-1729-412b-9f05-0096f17f4948 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4873db0f2fbf4a77a617f2102a5ccfae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4df15f6a6dd45dab12d0b724076a23e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:11:03.734696 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-e8851720-1729-412b-9f05-0096f17f4948 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] 10.222.0.43 "GET /compute/v2.1/servers/57b6d980-40de-4505-a591-20b54645d37c" status: 200 len: 1680 microversion: 2.1 time: 0.158736 Jun 29 08:11:03.735332 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 438/885] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:11:03 2022] GET /compute/v2.1/servers/57b6d980-40de-4505-a591-20b54645d37c => generated 1680 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:11:04.751876 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-d89376e4-ee8e-46d1-9a09-f580aff0e415 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:11:04.752573 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-d89376e4-ee8e-46d1-9a09-f580aff0e415 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] [instance: 57b6d980-40de-4505-a591-20b54645d37c] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:11:04.758935 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-d89376e4-ee8e-46d1-9a09-f580aff0e415 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:11:04.759380 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-d89376e4-ee8e-46d1-9a09-f580aff0e415 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:11:04.760135 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-d89376e4-ee8e-46d1-9a09-f580aff0e415 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:11:04.760572 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-d89376e4-ee8e-46d1-9a09-f580aff0e415 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:11:04.894881 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-d89376e4-ee8e-46d1-9a09-f580aff0e415 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4873db0f2fbf4a77a617f2102a5ccfae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4df15f6a6dd45dab12d0b724076a23e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:11:04.902409 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-d89376e4-ee8e-46d1-9a09-f580aff0e415 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] 10.222.0.43 "GET /compute/v2.1/servers/57b6d980-40de-4505-a591-20b54645d37c" status: 200 len: 1680 microversion: 2.1 time: 0.155383 Jun 29 08:11:04.902973 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 448/886] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:11:04 2022] GET /compute/v2.1/servers/57b6d980-40de-4505-a591-20b54645d37c => generated 1680 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:11:05.920285 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-7246a5d8-cc64-4b2c-8409-e737548d6af8 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:11:05.922043 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-7246a5d8-cc64-4b2c-8409-e737548d6af8 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] [instance: 57b6d980-40de-4505-a591-20b54645d37c] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:11:05.928457 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-7246a5d8-cc64-4b2c-8409-e737548d6af8 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:11:05.928997 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-7246a5d8-cc64-4b2c-8409-e737548d6af8 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:11:05.929833 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-7246a5d8-cc64-4b2c-8409-e737548d6af8 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:11:05.930267 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-7246a5d8-cc64-4b2c-8409-e737548d6af8 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:11:06.075140 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-7246a5d8-cc64-4b2c-8409-e737548d6af8 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4873db0f2fbf4a77a617f2102a5ccfae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4df15f6a6dd45dab12d0b724076a23e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:11:06.083169 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-7246a5d8-cc64-4b2c-8409-e737548d6af8 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] 10.222.0.43 "GET /compute/v2.1/servers/57b6d980-40de-4505-a591-20b54645d37c" status: 200 len: 1680 microversion: 2.1 time: 0.166927 Jun 29 08:11:06.083689 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 439/887] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:11:05 2022] GET /compute/v2.1/servers/57b6d980-40de-4505-a591-20b54645d37c => generated 1680 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:11:07.100091 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-a6124d26-3d39-422c-8c30-9c453c37a220 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:11:07.100737 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-a6124d26-3d39-422c-8c30-9c453c37a220 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] [instance: 57b6d980-40de-4505-a591-20b54645d37c] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:11:07.107374 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-a6124d26-3d39-422c-8c30-9c453c37a220 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:11:07.107855 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-a6124d26-3d39-422c-8c30-9c453c37a220 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:11:07.109894 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-a6124d26-3d39-422c-8c30-9c453c37a220 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:11:07.110343 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-a6124d26-3d39-422c-8c30-9c453c37a220 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:11:07.246917 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-a6124d26-3d39-422c-8c30-9c453c37a220 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4873db0f2fbf4a77a617f2102a5ccfae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4df15f6a6dd45dab12d0b724076a23e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:11:07.255498 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-a6124d26-3d39-422c-8c30-9c453c37a220 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] 10.222.0.43 "GET /compute/v2.1/servers/57b6d980-40de-4505-a591-20b54645d37c" status: 200 len: 1680 microversion: 2.1 time: 0.159251 Jun 29 08:11:07.256080 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 449/888] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:11:07 2022] GET /compute/v2.1/servers/57b6d980-40de-4505-a591-20b54645d37c => generated 1680 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:11:08.274621 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-7e35bbae-dbeb-4c7f-a083-e2cd3dedfd99 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:11:08.275619 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-7e35bbae-dbeb-4c7f-a083-e2cd3dedfd99 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] [instance: 57b6d980-40de-4505-a591-20b54645d37c] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:11:08.283243 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-7e35bbae-dbeb-4c7f-a083-e2cd3dedfd99 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:11:08.283773 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-7e35bbae-dbeb-4c7f-a083-e2cd3dedfd99 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:11:08.284589 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-7e35bbae-dbeb-4c7f-a083-e2cd3dedfd99 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:11:08.285060 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-7e35bbae-dbeb-4c7f-a083-e2cd3dedfd99 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:11:08.394342 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-7e35bbae-dbeb-4c7f-a083-e2cd3dedfd99 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4873db0f2fbf4a77a617f2102a5ccfae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4df15f6a6dd45dab12d0b724076a23e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:11:08.409324 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-7e35bbae-dbeb-4c7f-a083-e2cd3dedfd99 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] 10.222.0.43 "GET /compute/v2.1/servers/57b6d980-40de-4505-a591-20b54645d37c" status: 200 len: 1612 microversion: 2.1 time: 0.138818 Jun 29 08:11:08.410779 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 440/889] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:11:08 2022] GET /compute/v2.1/servers/57b6d980-40de-4505-a591-20b54645d37c => generated 1612 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 08:11:08.604005 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [req-56eee675-bf5f-48d7-8b39-946d184bc1a0 req-03f411b2-11cf-439c-ab8c-2fdfaaf38cb0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "57b6d980-40de-4505-a591-20b54645d37c", "name": "network-vif-deleted", "tag": "ef9d6628-7dec-44df-ae2b-420055caab1c"}]} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:11:08.614298 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-56eee675-bf5f-48d7-8b39-946d184bc1a0 req-03f411b2-11cf-439c-ab8c-2fdfaaf38cb0 service nova] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:11:08.615051 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-56eee675-bf5f-48d7-8b39-946d184bc1a0 req-03f411b2-11cf-439c-ab8c-2fdfaaf38cb0 service nova] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:11:08.636126 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.compute.server_external_events [req-56eee675-bf5f-48d7-8b39-946d184bc1a0 req-03f411b2-11cf-439c-ab8c-2fdfaaf38cb0 service nova] Creating event network-vif-deleted:ef9d6628-7dec-44df-ae2b-420055caab1c for instance 57b6d980-40de-4505-a591-20b54645d37c on hv-cinder-76810 Jun 29 08:11:08.642144 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [req-56eee675-bf5f-48d7-8b39-946d184bc1a0 req-03f411b2-11cf-439c-ab8c-2fdfaaf38cb0 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043628 Jun 29 08:11:08.643083 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 450/890] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jun 29 08:11:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:11:09.435525 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-a9e3a71b-ef25-4085-be26-1368ccf0b2ef tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:11:09.436248 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-a9e3a71b-ef25-4085-be26-1368ccf0b2ef tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] [instance: 57b6d980-40de-4505-a591-20b54645d37c] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:11:09.442931 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-a9e3a71b-ef25-4085-be26-1368ccf0b2ef tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:11:09.443384 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-a9e3a71b-ef25-4085-be26-1368ccf0b2ef tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:11:09.444227 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-a9e3a71b-ef25-4085-be26-1368ccf0b2ef tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:11:09.444634 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-a9e3a71b-ef25-4085-be26-1368ccf0b2ef tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:11:09.488892 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-a9e3a71b-ef25-4085-be26-1368ccf0b2ef tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:11:09.489628 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-a9e3a71b-ef25-4085-be26-1368ccf0b2ef tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:11:09.490248 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.objects.instance [None req-a9e3a71b-ef25-4085-be26-1368ccf0b2ef tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lazy-loading 'fault' on Instance uuid 57b6d980-40de-4505-a591-20b54645d37c {{(pid=117890) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 29 08:11:09.536333 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-a9e3a71b-ef25-4085-be26-1368ccf0b2ef tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4873db0f2fbf4a77a617f2102a5ccfae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4df15f6a6dd45dab12d0b724076a23e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:11:09.544448 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-a9e3a71b-ef25-4085-be26-1368ccf0b2ef tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] 10.222.0.43 "GET /compute/v2.1/servers/57b6d980-40de-4505-a591-20b54645d37c" status: 200 len: 1331 microversion: 2.1 time: 0.112328 Jun 29 08:11:09.555781 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 441/891] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:11:09 2022] GET /compute/v2.1/servers/57b6d980-40de-4505-a591-20b54645d37c => generated 1331 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:11:10.564638 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-f259e283-b879-41fd-935d-3b1efd1b495f tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:11:10.565408 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-f259e283-b879-41fd-935d-3b1efd1b495f tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] [instance: 57b6d980-40de-4505-a591-20b54645d37c] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:11:10.572386 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-f259e283-b879-41fd-935d-3b1efd1b495f tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:11:10.572842 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-f259e283-b879-41fd-935d-3b1efd1b495f tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:11:10.573669 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-f259e283-b879-41fd-935d-3b1efd1b495f tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:11:10.574115 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-f259e283-b879-41fd-935d-3b1efd1b495f tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:11:10.588712 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.wsgi [None req-f259e283-b879-41fd-935d-3b1efd1b495f tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] HTTP exception thrown: Instance 57b6d980-40de-4505-a591-20b54645d37c could not be found. Jun 29 08:11:10.590509 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-f259e283-b879-41fd-935d-3b1efd1b495f tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Request method failure captured: Jun 29 08:11:10.590509 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: request: GET /compute/v2.1/servers/57b6d980-40de-4505-a591-20b54645d37c HTTP/1.1 Jun 29 08:11:10.590509 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: Accept: application/json Jun 29 08:11:10.590509 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: Accept-Encoding: identity Jun 29 08:11:10.590509 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: Connection: close Jun 29 08:11:10.590509 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: Content-Length: 0 Jun 29 08:11:10.590509 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: Content-Type: application/json Jun 29 08:11:10.590509 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: Host: 10.222.0.43 Jun 29 08:11:10.590509 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: Openstack-System-Scope: None Jun 29 08:11:10.590509 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: User-Agent: python-urllib3/1.26.9 Jun 29 08:11:10.590509 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Auth-Token: gAAAAABivAiYnWOqjiwHcE1PCPUmCrIvEMkbVX7lWZxh9jPOZ_GtAOja07fGzXFEXqZ7Ky0xacgV6SGsTaq5tzX8bh-ZG0acOi-203kWLHdiaJ2wslMtHKMClYhsYgyOgs9fcpZ5v5SN8dlG-3pGiAd5z4Hj9kmL7TX1CMp1QfZwI7CaxfijbC4 Jun 29 08:11:10.590509 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Domain-Id: None Jun 29 08:11:10.590509 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Domain-Name: None Jun 29 08:11:10.590509 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Identity-Status: Confirmed Jun 29 08:11:10.590509 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Is-Admin-Project: True Jun 29 08:11:10.590509 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Project-Domain-Id: default Jun 29 08:11:10.590509 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Project-Domain-Name: Default Jun 29 08:11:10.590509 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Project-Id: a4df15f6a6dd45dab12d0b724076a23e Jun 29 08:11:10.590509 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Project-Name: tempest-AttachVolumeNegativeTest-471433960 Jun 29 08:11:10.590509 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Role: member,reader Jun 29 08:11:10.590509 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Roles: member,reader Jun 29 08:11:10.592675 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a4df15f6a6dd45dab12d0b724076a23e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_a4df15f6a6dd45dab12d0b724076a23e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a4df15f6a6dd45dab12d0b724076a23e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/a4df15f6a6dd45dab12d0b724076a23e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Jun 29 08:11:10.592675 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Tenant: tempest-AttachVolumeNegativeTest-471433960 Jun 29 08:11:10.592675 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Tenant-Id: a4df15f6a6dd45dab12d0b724076a23e Jun 29 08:11:10.592675 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-471433960 Jun 29 08:11:10.592675 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-User: tempest-AttachVolumeNegativeTest-471433960-project Jun 29 08:11:10.592675 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-User-Domain-Id: default Jun 29 08:11:10.592675 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-User-Domain-Name: Default Jun 29 08:11:10.592675 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-User-Id: 4873db0f2fbf4a77a617f2102a5ccfae Jun 29 08:11:10.592675 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-User-Name: tempest-AttachVolumeNegativeTest-471433960-project Jun 29 08:11:10.592675 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: method: > Jun 29 08:11:10.592675 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: exception: Instance 57b6d980-40de-4505-a591-20b54645d37c could not be found. Jun 29 08:11:10.592675 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: action_args: {'id': '57b6d980-40de-4505-a591-20b54645d37c'} Jun 29 08:11:10.593748 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 08:11:10.593748 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:11:10.593748 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 29 08:11:10.593748 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 29 08:11:10.593748 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 29 08:11:10.593748 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 29 08:11:10.593748 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 29 08:11:10.593748 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 29 08:11:10.593748 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 29 08:11:10.593748 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 29 08:11:10.593748 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 57b6d980-40de-4505-a591-20b54645d37c could not be found. Jun 29 08:11:10.593748 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 29 08:11:10.593748 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 08:11:10.593748 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 29 08:11:10.593748 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:11:10.593748 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 08:11:10.593748 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 08:11:10.593748 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 08:11:10.593748 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 08:11:10.593748 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 08:11:10.595989 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 08:11:10.595989 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 29 08:11:10.595989 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 29 08:11:10.595989 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 29 08:11:10.595989 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 29 08:11:10.595989 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 29 08:11:10.595989 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 29 08:11:10.595989 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 57b6d980-40de-4505-a591-20b54645d37c could not be found. Jun 29 08:11:10.595989 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 29 08:11:10.595989 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 08:11:10.595989 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 29 08:11:10.595989 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:11:10.595989 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 08:11:10.595989 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 08:11:10.595989 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 08:11:10.595989 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 08:11:10.595989 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 57b6d980-40de-4505-a591-20b54645d37c could not be found. Jun 29 08:11:10.595989 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 29 08:11:10.597726 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-f259e283-b879-41fd-935d-3b1efd1b495f tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Returning 404 to user: Instance 57b6d980-40de-4505-a591-20b54645d37c could not be found. {{(pid=117889) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 08:11:10.597726 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-f259e283-b879-41fd-935d-3b1efd1b495f tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] 10.222.0.43 "GET /compute/v2.1/servers/57b6d980-40de-4505-a591-20b54645d37c" status: 404 len: 111 microversion: 2.1 time: 0.032210 Jun 29 08:11:10.597726 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 451/892] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:11:10 2022] GET /compute/v2.1/servers/57b6d980-40de-4505-a591-20b54645d37c => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 29 08:11:10.602998 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-441789de-bbce-47ea-aa9c-891206cacb27 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Calling method '.version_select at 0x7f724122fee0>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:11:10.623351 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-441789de-bbce-47ea-aa9c-891206cacb27 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-586181879" status: 202 len: 0 microversion: 2.1 time: 0.024130 Jun 29 08:11:10.624555 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 442/893] 10.222.0.43 () {58 vars in 1217 bytes} [Wed Jun 29 08:11:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-586181879 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 29 08:11:11.578864 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-8d17e3ce-ec55-4d62-ba69-425be4ce557c tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Action: 'create', calling method: .version_select at 0x7f72410d2dc0>, body: {"keypair": {"name": "tempest-keypair-925894846", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBhX6TJLxQPVORWB+3RbnvwlcnYOhTmP0/EuDSK+LLUBoUGrZ/gs/7cQel7acsjZqmsXjehGLpqzXaUpfWQDteN39i67n4eTvtK35UbGRXuvutEts7HxNZ8r53iMuWSNfg=="}} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:11:11.594413 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.quota [None req-8d17e3ce-ec55-4d62-ba69-425be4ce557c tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Getting quotas for project a4df15f6a6dd45dab12d0b724076a23e. Resources: {'key_pairs'} {{(pid=117889) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 29 08:11:11.598371 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.quota [None req-8d17e3ce-ec55-4d62-ba69-425be4ce557c tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Getting quotas for user 4873db0f2fbf4a77a617f2102a5ccfae and project a4df15f6a6dd45dab12d0b724076a23e. Resources: {'key_pairs'} {{(pid=117889) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 29 08:11:11.623882 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-8d17e3ce-ec55-4d62-ba69-425be4ce557c tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.049269 Jun 29 08:11:11.625223 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 452/894] 10.222.0.43 () {60 vars in 1158 bytes} [Wed Jun 29 08:11:11 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 29 08:11:13.116918 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-0bef9c25-c4ee-443c-a601-dc5dbd5b4ea6 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-35792982", "imageRef": "5d2148a0-3628-4eff-88e9-5686abc0d33e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "501bffb4-f18b-4ba3-b604-4fd9c7554413"}], "security_groups": [{"name": "tempest-securitygroup--2057126986"}], "key_name": "tempest-keypair-925894846", "user_data": "}} {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:11:13.223413 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.network.neutron [None req-0bef9c25-c4ee-443c-a601-dc5dbd5b4ea6 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] validate_networks() for [('501bffb4-f18b-4ba3-b604-4fd9c7554413', None, None, None, None, None)] {{(pid=117890) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 29 08:11:13.650212 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.virt.hardware [None req-0bef9c25-c4ee-443c-a601-dc5dbd5b4ea6 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Flavor limits 0:0:0 {{(pid=117890) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 29 08:11:13.650641 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.virt.hardware [None req-0bef9c25-c4ee-443c-a601-dc5dbd5b4ea6 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Image limits 0:0:0 {{(pid=117890) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 29 08:11:13.651123 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.virt.hardware [None req-0bef9c25-c4ee-443c-a601-dc5dbd5b4ea6 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Flavor pref 0:0:0 {{(pid=117890) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 29 08:11:13.651535 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.virt.hardware [None req-0bef9c25-c4ee-443c-a601-dc5dbd5b4ea6 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Image pref 0:0:0 {{(pid=117890) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 29 08:11:13.651952 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.virt.hardware [None req-0bef9c25-c4ee-443c-a601-dc5dbd5b4ea6 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117890) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 29 08:11:13.663367 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-0bef9c25-c4ee-443c-a601-dc5dbd5b4ea6 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:11:13.663763 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-0bef9c25-c4ee-443c-a601-dc5dbd5b4ea6 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:11:13.664675 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-0bef9c25-c4ee-443c-a601-dc5dbd5b4ea6 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:11:13.665144 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-0bef9c25-c4ee-443c-a601-dc5dbd5b4ea6 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:11:13.684782 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.quota [None req-0bef9c25-c4ee-443c-a601-dc5dbd5b4ea6 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Getting quotas for project a4df15f6a6dd45dab12d0b724076a23e. Resources: {'ram', 'instances', 'cores'} {{(pid=117890) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 29 08:11:13.690403 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.quota [None req-0bef9c25-c4ee-443c-a601-dc5dbd5b4ea6 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Getting quotas for user 4873db0f2fbf4a77a617f2102a5ccfae and project a4df15f6a6dd45dab12d0b724076a23e. Resources: {'ram', 'instances', 'cores'} {{(pid=117890) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 29 08:11:13.703489 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-0bef9c25-c4ee-443c-a601-dc5dbd5b4ea6 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Going to run 1 instances... {{(pid=117890) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 29 08:11:13.705876 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-0bef9c25-c4ee-443c-a601-dc5dbd5b4ea6 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] [instance: 01330f68-42df-4986-b996-e6403d1555c6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5d2148a0-3628-4eff-88e9-5686abc0d33e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117890) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 29 08:11:13.757212 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-0bef9c25-c4ee-443c-a601-dc5dbd5b4ea6 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.645221 Jun 29 08:11:13.757850 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 443/895] 10.222.0.43 () {60 vars in 1146 bytes} [Wed Jun 29 08:11:13 2022] POST /compute/v2.1/servers => generated 402 bytes in 647 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 29 08:11:13.769965 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-ea73fef6-6a82-4568-999a-aa9bd090cc3d tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:11:13.770773 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-ea73fef6-6a82-4568-999a-aa9bd090cc3d tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] [instance: 01330f68-42df-4986-b996-e6403d1555c6] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:11:13.828962 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-ea73fef6-6a82-4568-999a-aa9bd090cc3d tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4873db0f2fbf4a77a617f2102a5ccfae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4df15f6a6dd45dab12d0b724076a23e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:11:13.835902 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-ea73fef6-6a82-4568-999a-aa9bd090cc3d tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] 10.222.0.43 "GET /compute/v2.1/servers/01330f68-42df-4986-b996-e6403d1555c6" status: 200 len: 1239 microversion: 2.1 time: 0.070869 Jun 29 08:11:13.836483 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 453/896] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:11:13 2022] GET /compute/v2.1/servers/01330f68-42df-4986-b996-e6403d1555c6 => generated 1239 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:11:14.854967 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-646f2fda-f0a1-4c4d-89b5-a1e55a2205eb tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:11:14.855699 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-646f2fda-f0a1-4c4d-89b5-a1e55a2205eb tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] [instance: 01330f68-42df-4986-b996-e6403d1555c6] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:11:14.866130 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-646f2fda-f0a1-4c4d-89b5-a1e55a2205eb tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:11:14.866905 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-646f2fda-f0a1-4c4d-89b5-a1e55a2205eb tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:11:14.868230 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-646f2fda-f0a1-4c4d-89b5-a1e55a2205eb tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:11:14.868939 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-646f2fda-f0a1-4c4d-89b5-a1e55a2205eb tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:11:14.945364 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-646f2fda-f0a1-4c4d-89b5-a1e55a2205eb tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4873db0f2fbf4a77a617f2102a5ccfae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4df15f6a6dd45dab12d0b724076a23e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:11:14.954889 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-646f2fda-f0a1-4c4d-89b5-a1e55a2205eb tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] 10.222.0.43 "GET /compute/v2.1/servers/01330f68-42df-4986-b996-e6403d1555c6" status: 200 len: 1243 microversion: 2.1 time: 0.105213 Jun 29 08:11:14.955550 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 444/897] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:11:14 2022] GET /compute/v2.1/servers/01330f68-42df-4986-b996-e6403d1555c6 => generated 1243 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:11:15.973426 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-33360929-56ac-47f2-a2ff-2a34a0c42291 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:11:15.974121 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-33360929-56ac-47f2-a2ff-2a34a0c42291 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] [instance: 01330f68-42df-4986-b996-e6403d1555c6] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:11:15.992694 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-33360929-56ac-47f2-a2ff-2a34a0c42291 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:11:15.993593 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-33360929-56ac-47f2-a2ff-2a34a0c42291 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:11:15.997529 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-33360929-56ac-47f2-a2ff-2a34a0c42291 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:11:15.998090 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-33360929-56ac-47f2-a2ff-2a34a0c42291 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:11:16.133505 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-33360929-56ac-47f2-a2ff-2a34a0c42291 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4873db0f2fbf4a77a617f2102a5ccfae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4df15f6a6dd45dab12d0b724076a23e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:11:16.144467 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-33360929-56ac-47f2-a2ff-2a34a0c42291 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] 10.222.0.43 "GET /compute/v2.1/servers/01330f68-42df-4986-b996-e6403d1555c6" status: 200 len: 1309 microversion: 2.1 time: 0.176522 Jun 29 08:11:16.145776 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 454/898] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:11:15 2022] GET /compute/v2.1/servers/01330f68-42df-4986-b996-e6403d1555c6 => generated 1309 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:11:17.171756 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-d5091de0-7904-4378-b93f-f3e8488a2a20 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:11:17.172354 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-d5091de0-7904-4378-b93f-f3e8488a2a20 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] [instance: 01330f68-42df-4986-b996-e6403d1555c6] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:11:17.179548 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-d5091de0-7904-4378-b93f-f3e8488a2a20 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:11:17.180009 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-d5091de0-7904-4378-b93f-f3e8488a2a20 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:11:17.180835 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-d5091de0-7904-4378-b93f-f3e8488a2a20 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:11:17.181320 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-d5091de0-7904-4378-b93f-f3e8488a2a20 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:11:17.259483 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-d5091de0-7904-4378-b93f-f3e8488a2a20 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4873db0f2fbf4a77a617f2102a5ccfae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4df15f6a6dd45dab12d0b724076a23e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:11:17.270781 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-d5091de0-7904-4378-b93f-f3e8488a2a20 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] 10.222.0.43 "GET /compute/v2.1/servers/01330f68-42df-4986-b996-e6403d1555c6" status: 200 len: 1297 microversion: 2.1 time: 0.103289 Jun 29 08:11:17.271259 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 445/899] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:11:17 2022] GET /compute/v2.1/servers/01330f68-42df-4986-b996-e6403d1555c6 => generated 1297 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:11:18.288750 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-b7f7acc0-01b2-42dc-9933-5551047b49ff tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:11:18.289415 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-b7f7acc0-01b2-42dc-9933-5551047b49ff tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] [instance: 01330f68-42df-4986-b996-e6403d1555c6] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:11:18.297359 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-b7f7acc0-01b2-42dc-9933-5551047b49ff tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:11:18.297824 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-b7f7acc0-01b2-42dc-9933-5551047b49ff tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:11:18.298676 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-b7f7acc0-01b2-42dc-9933-5551047b49ff tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:11:18.299068 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-b7f7acc0-01b2-42dc-9933-5551047b49ff tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:11:18.440339 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-b7f7acc0-01b2-42dc-9933-5551047b49ff tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4873db0f2fbf4a77a617f2102a5ccfae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4df15f6a6dd45dab12d0b724076a23e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:11:18.448433 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-b7f7acc0-01b2-42dc-9933-5551047b49ff tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] 10.222.0.43 "GET /compute/v2.1/servers/01330f68-42df-4986-b996-e6403d1555c6" status: 200 len: 1365 microversion: 2.1 time: 0.163554 Jun 29 08:11:18.449024 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 455/900] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:11:18 2022] GET /compute/v2.1/servers/01330f68-42df-4986-b996-e6403d1555c6 => generated 1365 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:11:19.475326 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-375506b2-ce2c-4663-a02d-4468574d722b tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:11:19.477045 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-375506b2-ce2c-4663-a02d-4468574d722b tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] [instance: 01330f68-42df-4986-b996-e6403d1555c6] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:11:19.487794 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-375506b2-ce2c-4663-a02d-4468574d722b tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:11:19.488561 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-375506b2-ce2c-4663-a02d-4468574d722b tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:11:19.489777 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-375506b2-ce2c-4663-a02d-4468574d722b tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:11:19.490516 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-375506b2-ce2c-4663-a02d-4468574d722b tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:11:19.680671 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-375506b2-ce2c-4663-a02d-4468574d722b tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4873db0f2fbf4a77a617f2102a5ccfae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4df15f6a6dd45dab12d0b724076a23e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:11:19.690175 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-375506b2-ce2c-4663-a02d-4468574d722b tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] 10.222.0.43 "GET /compute/v2.1/servers/01330f68-42df-4986-b996-e6403d1555c6" status: 200 len: 1365 microversion: 2.1 time: 0.227595 Jun 29 08:11:19.690747 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 446/901] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:11:19 2022] GET /compute/v2.1/servers/01330f68-42df-4986-b996-e6403d1555c6 => generated 1365 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 08:11:20.277282 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [req-eb1e8618-0879-41d1-abe3-cc0c298487f8 req-cfbf897b-195d-4ea9-b37d-0c3c819eaa97 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "01330f68-42df-4986-b996-e6403d1555c6", "tag": "46cb7d49-04c0-46a7-8dd7-77f912b18d6d"}]} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:11:20.307738 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-eb1e8618-0879-41d1-abe3-cc0c298487f8 req-cfbf897b-195d-4ea9-b37d-0c3c819eaa97 service nova] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:11:20.308553 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-eb1e8618-0879-41d1-abe3-cc0c298487f8 req-cfbf897b-195d-4ea9-b37d-0c3c819eaa97 service nova] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:11:20.334895 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.compute.server_external_events [req-eb1e8618-0879-41d1-abe3-cc0c298487f8 req-cfbf897b-195d-4ea9-b37d-0c3c819eaa97 service nova] Creating event network-changed:46cb7d49-04c0-46a7-8dd7-77f912b18d6d for instance 01330f68-42df-4986-b996-e6403d1555c6 on hv-cinder-76810 Jun 29 08:11:20.346227 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [req-eb1e8618-0879-41d1-abe3-cc0c298487f8 req-cfbf897b-195d-4ea9-b37d-0c3c819eaa97 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078686 Jun 29 08:11:20.347536 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 456/902] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jun 29 08:11:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 29 08:11:20.710110 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-84dc7718-5c8c-4083-af92-429a39d43f0f tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:11:20.710758 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-84dc7718-5c8c-4083-af92-429a39d43f0f tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] [instance: 01330f68-42df-4986-b996-e6403d1555c6] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:11:20.721397 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-84dc7718-5c8c-4083-af92-429a39d43f0f tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:11:20.721952 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-84dc7718-5c8c-4083-af92-429a39d43f0f tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:11:20.722742 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-84dc7718-5c8c-4083-af92-429a39d43f0f tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:11:20.723299 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-84dc7718-5c8c-4083-af92-429a39d43f0f tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:11:20.937647 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-84dc7718-5c8c-4083-af92-429a39d43f0f tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4873db0f2fbf4a77a617f2102a5ccfae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4df15f6a6dd45dab12d0b724076a23e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:11:20.947400 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-84dc7718-5c8c-4083-af92-429a39d43f0f tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] 10.222.0.43 "GET /compute/v2.1/servers/01330f68-42df-4986-b996-e6403d1555c6" status: 200 len: 1365 microversion: 2.1 time: 0.241123 Jun 29 08:11:20.954029 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 447/903] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:11:20 2022] GET /compute/v2.1/servers/01330f68-42df-4986-b996-e6403d1555c6 => generated 1365 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 08:11:20.993195 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-b024682f-179b-4338-a78e-5d2a307742b2 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:11:20.994170 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-b024682f-179b-4338-a78e-5d2a307742b2 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] [instance: 83a86ef0-c066-44a7-b4eb-e32dce6e0069] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:11:21.004225 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-b024682f-179b-4338-a78e-5d2a307742b2 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:11:21.004887 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-b024682f-179b-4338-a78e-5d2a307742b2 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:11:21.006498 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-b024682f-179b-4338-a78e-5d2a307742b2 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:11:21.006498 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-b024682f-179b-4338-a78e-5d2a307742b2 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:11:21.040298 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-b024682f-179b-4338-a78e-5d2a307742b2 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] [instance: 83a86ef0-c066-44a7-b4eb-e32dce6e0069] Going to try to terminate instance {{(pid=117889) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 29 08:11:21.168389 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-b024682f-179b-4338-a78e-5d2a307742b2 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] 10.222.0.43 "DELETE /compute/v2.1/servers/83a86ef0-c066-44a7-b4eb-e32dce6e0069" status: 204 len: 0 microversion: 2.1 time: 0.183069 Jun 29 08:11:21.173412 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 457/904] 10.222.0.43 () {58 vars in 1238 bytes} [Wed Jun 29 08:11:20 2022] DELETE /compute/v2.1/servers/83a86ef0-c066-44a7-b4eb-e32dce6e0069 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 29 08:11:21.182373 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-81875256-29bd-4eb8-8506-4fa127e9aa08 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:11:21.183514 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-81875256-29bd-4eb8-8506-4fa127e9aa08 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] [instance: 83a86ef0-c066-44a7-b4eb-e32dce6e0069] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:11:21.194759 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-81875256-29bd-4eb8-8506-4fa127e9aa08 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:11:21.195386 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-81875256-29bd-4eb8-8506-4fa127e9aa08 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:11:21.196726 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-81875256-29bd-4eb8-8506-4fa127e9aa08 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:11:21.197561 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-81875256-29bd-4eb8-8506-4fa127e9aa08 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:11:21.368356 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-81875256-29bd-4eb8-8506-4fa127e9aa08 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de6636a0522642799e43a8f02ee602ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a20f6f9f254aae91c952ee44a4ff74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:11:21.377111 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-81875256-29bd-4eb8-8506-4fa127e9aa08 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] 10.222.0.43 "GET /compute/v2.1/servers/83a86ef0-c066-44a7-b4eb-e32dce6e0069" status: 200 len: 1570 microversion: 2.1 time: 0.202127 Jun 29 08:11:21.377990 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 448/905] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:11:21 2022] GET /compute/v2.1/servers/83a86ef0-c066-44a7-b4eb-e32dce6e0069 => generated 1570 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:11:21.966988 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-4dbd434c-51d5-4be6-bca1-b07a71421555 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:11:21.968328 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-4dbd434c-51d5-4be6-bca1-b07a71421555 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] [instance: 01330f68-42df-4986-b996-e6403d1555c6] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:11:21.976867 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-4dbd434c-51d5-4be6-bca1-b07a71421555 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:11:21.977367 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-4dbd434c-51d5-4be6-bca1-b07a71421555 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:11:21.978297 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-4dbd434c-51d5-4be6-bca1-b07a71421555 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:11:21.979167 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-4dbd434c-51d5-4be6-bca1-b07a71421555 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:11:22.008319 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:11:22.201496 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-4dbd434c-51d5-4be6-bca1-b07a71421555 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4873db0f2fbf4a77a617f2102a5ccfae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4df15f6a6dd45dab12d0b724076a23e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:11:22.210081 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-4dbd434c-51d5-4be6-bca1-b07a71421555 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] 10.222.0.43 "GET /compute/v2.1/servers/01330f68-42df-4986-b996-e6403d1555c6" status: 200 len: 1365 microversion: 2.1 time: 0.247862 Jun 29 08:11:22.211036 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 458/906] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:11:21 2022] GET /compute/v2.1/servers/01330f68-42df-4986-b996-e6403d1555c6 => generated 1365 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:11:22.377860 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [req-3c6910d7-3494-4e3f-aa5f-a58afacdfee4 req-a1561501-97cb-484a-89c6-5eabeab12dd4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "83a86ef0-c066-44a7-b4eb-e32dce6e0069", "tag": "3828b918-ada6-49b4-b99e-2bfa66c92b2d"}]} {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:11:22.387849 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [req-3c6910d7-3494-4e3f-aa5f-a58afacdfee4 req-a1561501-97cb-484a-89c6-5eabeab12dd4 service nova] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:11:22.388308 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [req-3c6910d7-3494-4e3f-aa5f-a58afacdfee4 req-a1561501-97cb-484a-89c6-5eabeab12dd4 service nova] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:11:22.396334 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-a689d651-fc1a-45a1-8b58-735e91cafddf tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:11:22.397423 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-a689d651-fc1a-45a1-8b58-735e91cafddf tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] [instance: 83a86ef0-c066-44a7-b4eb-e32dce6e0069] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:11:22.401544 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.compute.server_external_events [req-3c6910d7-3494-4e3f-aa5f-a58afacdfee4 req-a1561501-97cb-484a-89c6-5eabeab12dd4 service nova] Creating event network-changed:3828b918-ada6-49b4-b99e-2bfa66c92b2d for instance 83a86ef0-c066-44a7-b4eb-e32dce6e0069 on hv-cinder-76810 Jun 29 08:11:22.406100 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-a689d651-fc1a-45a1-8b58-735e91cafddf tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:11:22.406785 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [req-3c6910d7-3494-4e3f-aa5f-a58afacdfee4 req-a1561501-97cb-484a-89c6-5eabeab12dd4 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033435 Jun 29 08:11:22.407037 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-a689d651-fc1a-45a1-8b58-735e91cafddf tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:11:22.407390 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 449/907] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jun 29 08:11:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:11:22.408282 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-a689d651-fc1a-45a1-8b58-735e91cafddf tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:11:22.408870 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-a689d651-fc1a-45a1-8b58-735e91cafddf tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:11:22.575586 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-a689d651-fc1a-45a1-8b58-735e91cafddf tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de6636a0522642799e43a8f02ee602ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a20f6f9f254aae91c952ee44a4ff74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:11:22.583999 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-a689d651-fc1a-45a1-8b58-735e91cafddf tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] 10.222.0.43 "GET /compute/v2.1/servers/83a86ef0-c066-44a7-b4eb-e32dce6e0069" status: 200 len: 1570 microversion: 2.1 time: 0.191476 Jun 29 08:11:22.584596 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 459/908] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:11:22 2022] GET /compute/v2.1/servers/83a86ef0-c066-44a7-b4eb-e32dce6e0069 => generated 1570 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 08:11:23.233551 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-602debed-aa8f-4f50-98ef-eb929304aaca tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:11:23.235398 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-602debed-aa8f-4f50-98ef-eb929304aaca tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] [instance: 01330f68-42df-4986-b996-e6403d1555c6] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:11:23.242292 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG dbcounter [-] [117890] Writing DB stats nova_api:SELECT=53,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=117890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:11:23.244061 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-602debed-aa8f-4f50-98ef-eb929304aaca tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:11:23.244509 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-602debed-aa8f-4f50-98ef-eb929304aaca tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:11:23.245545 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-602debed-aa8f-4f50-98ef-eb929304aaca tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:11:23.246192 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-602debed-aa8f-4f50-98ef-eb929304aaca tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:11:23.251540 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG dbcounter [-] [117890] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=1 {{(pid=117890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:11:23.609026 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-4a1f2e20-9ffd-4c1f-aca3-375db381e552 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:11:23.610633 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-4a1f2e20-9ffd-4c1f-aca3-375db381e552 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] [instance: 83a86ef0-c066-44a7-b4eb-e32dce6e0069] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:11:23.618781 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_api:SELECT=66,nova_api:UPDATE=3,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:11:23.621390 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-4a1f2e20-9ffd-4c1f-aca3-375db381e552 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:11:23.622149 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-4a1f2e20-9ffd-4c1f-aca3-375db381e552 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:11:23.624121 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-4a1f2e20-9ffd-4c1f-aca3-375db381e552 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:11:23.624833 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-4a1f2e20-9ffd-4c1f-aca3-375db381e552 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:11:23.674745 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG dbcounter [-] [117890] Writing DB stats nova_cell0:SELECT=2 {{(pid=117890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:11:23.697540 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG dbcounter [-] [117890] Writing DB stats nova_cell0:SELECT=6 {{(pid=117890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:11:23.747489 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-602debed-aa8f-4f50-98ef-eb929304aaca tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4873db0f2fbf4a77a617f2102a5ccfae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4df15f6a6dd45dab12d0b724076a23e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:11:23.765021 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-602debed-aa8f-4f50-98ef-eb929304aaca tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] 10.222.0.43 "GET /compute/v2.1/servers/01330f68-42df-4986-b996-e6403d1555c6" status: 200 len: 1365 microversion: 2.1 time: 0.538232 Jun 29 08:11:23.766876 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 450/909] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:11:23 2022] GET /compute/v2.1/servers/01330f68-42df-4986-b996-e6403d1555c6 => generated 1365 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:11:23.834720 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_cell0:SELECT=6 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:11:23.918274 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-4a1f2e20-9ffd-4c1f-aca3-375db381e552 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de6636a0522642799e43a8f02ee602ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a20f6f9f254aae91c952ee44a4ff74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:11:23.939698 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-4a1f2e20-9ffd-4c1f-aca3-375db381e552 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] 10.222.0.43 "GET /compute/v2.1/servers/83a86ef0-c066-44a7-b4eb-e32dce6e0069" status: 200 len: 1570 microversion: 2.1 time: 0.334228 Jun 29 08:11:23.942979 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 460/910] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:11:23 2022] GET /compute/v2.1/servers/83a86ef0-c066-44a7-b4eb-e32dce6e0069 => generated 1570 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:11:24.674426 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [req-43c3e037-9c5c-4ebb-9072-614a8d325ca2 req-7bff6af3-fda2-4a52-ac70-e2aa7071bb7c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "83a86ef0-c066-44a7-b4eb-e32dce6e0069", "name": "network-vif-deleted", "tag": "3828b918-ada6-49b4-b99e-2bfa66c92b2d"}]} {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:11:24.684869 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [req-43c3e037-9c5c-4ebb-9072-614a8d325ca2 req-7bff6af3-fda2-4a52-ac70-e2aa7071bb7c service nova] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:11:24.685830 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [req-43c3e037-9c5c-4ebb-9072-614a8d325ca2 req-7bff6af3-fda2-4a52-ac70-e2aa7071bb7c service nova] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:11:24.699536 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.compute.server_external_events [req-43c3e037-9c5c-4ebb-9072-614a8d325ca2 req-7bff6af3-fda2-4a52-ac70-e2aa7071bb7c service nova] Creating event network-vif-deleted:3828b918-ada6-49b4-b99e-2bfa66c92b2d for instance 83a86ef0-c066-44a7-b4eb-e32dce6e0069 on hv-cinder-76810 Jun 29 08:11:24.706186 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [req-43c3e037-9c5c-4ebb-9072-614a8d325ca2 req-7bff6af3-fda2-4a52-ac70-e2aa7071bb7c service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036581 Jun 29 08:11:24.710878 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 451/911] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jun 29 08:11:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:11:24.788207 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-8c00f37c-d04f-41de-aca7-d0d1b1b442a7 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:11:24.788962 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-8c00f37c-d04f-41de-aca7-d0d1b1b442a7 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] [instance: 01330f68-42df-4986-b996-e6403d1555c6] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:11:24.798477 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-8c00f37c-d04f-41de-aca7-d0d1b1b442a7 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:11:24.799717 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-8c00f37c-d04f-41de-aca7-d0d1b1b442a7 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:11:24.801936 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-8c00f37c-d04f-41de-aca7-d0d1b1b442a7 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:11:24.803063 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-8c00f37c-d04f-41de-aca7-d0d1b1b442a7 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:11:24.992554 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-ef8066d0-addf-42e9-b430-5c0583aa651a tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:11:24.994106 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-ef8066d0-addf-42e9-b430-5c0583aa651a tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] [instance: 83a86ef0-c066-44a7-b4eb-e32dce6e0069] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:11:25.009354 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-ef8066d0-addf-42e9-b430-5c0583aa651a tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:11:25.010124 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-ef8066d0-addf-42e9-b430-5c0583aa651a tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:11:25.011131 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-ef8066d0-addf-42e9-b430-5c0583aa651a tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:11:25.011737 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-ef8066d0-addf-42e9-b430-5c0583aa651a tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:11:25.028661 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-8c00f37c-d04f-41de-aca7-d0d1b1b442a7 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4873db0f2fbf4a77a617f2102a5ccfae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4df15f6a6dd45dab12d0b724076a23e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:11:25.041904 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-8c00f37c-d04f-41de-aca7-d0d1b1b442a7 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] 10.222.0.43 "GET /compute/v2.1/servers/01330f68-42df-4986-b996-e6403d1555c6" status: 200 len: 1365 microversion: 2.1 time: 0.257388 Jun 29 08:11:25.043627 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 461/912] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:11:24 2022] GET /compute/v2.1/servers/01330f68-42df-4986-b996-e6403d1555c6 => generated 1365 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:11:25.127013 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-ef8066d0-addf-42e9-b430-5c0583aa651a tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de6636a0522642799e43a8f02ee602ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26a20f6f9f254aae91c952ee44a4ff74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:11:25.137219 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-ef8066d0-addf-42e9-b430-5c0583aa651a tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] 10.222.0.43 "GET /compute/v2.1/servers/83a86ef0-c066-44a7-b4eb-e32dce6e0069" status: 200 len: 1219 microversion: 2.1 time: 0.170756 Jun 29 08:11:25.138093 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 452/913] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:11:24 2022] GET /compute/v2.1/servers/83a86ef0-c066-44a7-b4eb-e32dce6e0069 => generated 1219 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:11:26.062548 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-15ee96cc-f0a6-4666-89fa-23273b501893 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:11:26.063474 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-15ee96cc-f0a6-4666-89fa-23273b501893 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] [instance: 01330f68-42df-4986-b996-e6403d1555c6] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:11:26.071372 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-15ee96cc-f0a6-4666-89fa-23273b501893 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:11:26.071825 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-15ee96cc-f0a6-4666-89fa-23273b501893 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:11:26.072639 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-15ee96cc-f0a6-4666-89fa-23273b501893 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:11:26.073120 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-15ee96cc-f0a6-4666-89fa-23273b501893 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:11:26.157963 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-645659ce-83cf-44c8-82aa-8d798f488f29 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:11:26.158613 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-645659ce-83cf-44c8-82aa-8d798f488f29 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] [instance: 83a86ef0-c066-44a7-b4eb-e32dce6e0069] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:11:26.169411 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-645659ce-83cf-44c8-82aa-8d798f488f29 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:11:26.170671 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-645659ce-83cf-44c8-82aa-8d798f488f29 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:11:26.171598 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-645659ce-83cf-44c8-82aa-8d798f488f29 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:11:26.172070 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-645659ce-83cf-44c8-82aa-8d798f488f29 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:11:26.189250 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.wsgi [None req-645659ce-83cf-44c8-82aa-8d798f488f29 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] HTTP exception thrown: Instance 83a86ef0-c066-44a7-b4eb-e32dce6e0069 could not be found. Jun 29 08:11:26.191005 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-645659ce-83cf-44c8-82aa-8d798f488f29 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Request method failure captured: Jun 29 08:11:26.191005 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: request: GET /compute/v2.1/servers/83a86ef0-c066-44a7-b4eb-e32dce6e0069 HTTP/1.1 Jun 29 08:11:26.191005 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: Accept: application/json Jun 29 08:11:26.191005 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: Accept-Encoding: identity Jun 29 08:11:26.191005 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: Connection: close Jun 29 08:11:26.191005 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: Content-Length: 0 Jun 29 08:11:26.191005 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: Content-Type: application/json Jun 29 08:11:26.191005 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: Host: 10.222.0.43 Jun 29 08:11:26.191005 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: Openstack-System-Scope: None Jun 29 08:11:26.191005 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: User-Agent: python-urllib3/1.26.9 Jun 29 08:11:26.191005 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Auth-Token: gAAAAABivAe3uPOEAmRGOHqdYFjapDQULLHs8AYNcEMbriAELNhHgQbhUsgN-ZZ6J4wCRkBNe9zWLq2OILQgo63MPdRl2vfKaU79cdJxvV35Hy9nEBPDvqetvhGNWa98c4UNzaaKCNfxFgO7x6eaP0OApjjyhqBs0mfvxSB0Ccw_gOAUnd3Kooo Jun 29 08:11:26.191005 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Domain-Id: None Jun 29 08:11:26.191005 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Domain-Name: None Jun 29 08:11:26.191005 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Identity-Status: Confirmed Jun 29 08:11:26.191005 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Is-Admin-Project: True Jun 29 08:11:26.191005 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Project-Domain-Id: default Jun 29 08:11:26.191005 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Project-Domain-Name: Default Jun 29 08:11:26.191005 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Project-Id: 26a20f6f9f254aae91c952ee44a4ff74 Jun 29 08:11:26.191005 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Project-Name: tempest-TestShelveInstance-2118875996 Jun 29 08:11:26.191005 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Role: member,reader Jun 29 08:11:26.191005 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Roles: member,reader Jun 29 08:11:26.193000 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/26a20f6f9f254aae91c952ee44a4ff74"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_26a20f6f9f254aae91c952ee44a4ff74"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/26a20f6f9f254aae91c952ee44a4ff74"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/26a20f6f9f254aae91c952ee44a4ff74"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Jun 29 08:11:26.193000 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Tenant: tempest-TestShelveInstance-2118875996 Jun 29 08:11:26.193000 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Tenant-Id: 26a20f6f9f254aae91c952ee44a4ff74 Jun 29 08:11:26.193000 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Tenant-Name: tempest-TestShelveInstance-2118875996 Jun 29 08:11:26.193000 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-User: tempest-TestShelveInstance-2118875996-project Jun 29 08:11:26.193000 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-User-Domain-Id: default Jun 29 08:11:26.193000 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-User-Domain-Name: Default Jun 29 08:11:26.193000 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-User-Id: de6636a0522642799e43a8f02ee602ea Jun 29 08:11:26.193000 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-User-Name: tempest-TestShelveInstance-2118875996-project Jun 29 08:11:26.193000 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: method: > Jun 29 08:11:26.193000 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: exception: Instance 83a86ef0-c066-44a7-b4eb-e32dce6e0069 could not be found. Jun 29 08:11:26.193000 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: action_args: {'id': '83a86ef0-c066-44a7-b4eb-e32dce6e0069'} Jun 29 08:11:26.194652 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 08:11:26.194652 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:11:26.194652 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 29 08:11:26.194652 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 29 08:11:26.194652 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 29 08:11:26.194652 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 29 08:11:26.194652 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 29 08:11:26.194652 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 29 08:11:26.194652 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 29 08:11:26.194652 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 29 08:11:26.194652 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 83a86ef0-c066-44a7-b4eb-e32dce6e0069 could not be found. Jun 29 08:11:26.194652 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 29 08:11:26.194652 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 08:11:26.194652 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 29 08:11:26.194652 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:11:26.194652 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 08:11:26.194652 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 08:11:26.194652 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 08:11:26.194652 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 08:11:26.194652 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 08:11:26.197565 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 08:11:26.197565 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 29 08:11:26.197565 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 29 08:11:26.197565 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 29 08:11:26.197565 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 29 08:11:26.197565 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 29 08:11:26.197565 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 29 08:11:26.197565 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 83a86ef0-c066-44a7-b4eb-e32dce6e0069 could not be found. Jun 29 08:11:26.197565 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 29 08:11:26.197565 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 08:11:26.197565 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 29 08:11:26.197565 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:11:26.197565 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 08:11:26.197565 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 08:11:26.197565 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 08:11:26.197565 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 08:11:26.197565 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 83a86ef0-c066-44a7-b4eb-e32dce6e0069 could not be found. Jun 29 08:11:26.197565 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 29 08:11:26.201385 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-645659ce-83cf-44c8-82aa-8d798f488f29 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Returning 404 to user: Instance 83a86ef0-c066-44a7-b4eb-e32dce6e0069 could not be found. {{(pid=117890) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 08:11:26.201385 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-645659ce-83cf-44c8-82aa-8d798f488f29 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] 10.222.0.43 "GET /compute/v2.1/servers/83a86ef0-c066-44a7-b4eb-e32dce6e0069" status: 404 len: 111 microversion: 2.1 time: 0.040341 Jun 29 08:11:26.201385 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 453/914] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:11:26 2022] GET /compute/v2.1/servers/83a86ef0-c066-44a7-b4eb-e32dce6e0069 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 29 08:11:26.258660 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-15ee96cc-f0a6-4666-89fa-23273b501893 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4873db0f2fbf4a77a617f2102a5ccfae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4df15f6a6dd45dab12d0b724076a23e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:11:26.282003 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-15ee96cc-f0a6-4666-89fa-23273b501893 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] 10.222.0.43 "GET /compute/v2.1/servers/01330f68-42df-4986-b996-e6403d1555c6" status: 200 len: 1365 microversion: 2.1 time: 0.223444 Jun 29 08:11:26.282626 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 462/915] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:11:26 2022] GET /compute/v2.1/servers/01330f68-42df-4986-b996-e6403d1555c6 => generated 1365 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:11:26.432728 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-779c5dca-b118-47fd-a4b9-077674bd5e33 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] Calling method '.version_select at 0x7f72412374c0>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:11:26.473079 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-779c5dca-b118-47fd-a4b9-077674bd5e33 tempest-TestShelveInstance-2118875996 tempest-TestShelveInstance-2118875996-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-915127236" status: 202 len: 0 microversion: 2.1 time: 0.047693 Jun 29 08:11:26.474523 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 454/916] 10.222.0.43 () {58 vars in 1250 bytes} [Wed Jun 29 08:11:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-915127236 => generated 0 bytes in 50 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 29 08:11:26.995945 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [req-48310e03-5df9-4b09-901f-e9eef01bac52 req-85b6b404-6a0b-4166-ae4c-f694ad6e1bbe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "01330f68-42df-4986-b996-e6403d1555c6", "name": "network-vif-plugged", "status": "completed", "tag": "46cb7d49-04c0-46a7-8dd7-77f912b18d6d"}]} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:11:27.012235 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-48310e03-5df9-4b09-901f-e9eef01bac52 req-85b6b404-6a0b-4166-ae4c-f694ad6e1bbe service nova] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:11:27.013228 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-48310e03-5df9-4b09-901f-e9eef01bac52 req-85b6b404-6a0b-4166-ae4c-f694ad6e1bbe service nova] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:11:27.030180 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.compute.server_external_events [req-48310e03-5df9-4b09-901f-e9eef01bac52 req-85b6b404-6a0b-4166-ae4c-f694ad6e1bbe service nova] Creating event network-vif-plugged:46cb7d49-04c0-46a7-8dd7-77f912b18d6d for instance 01330f68-42df-4986-b996-e6403d1555c6 on hv-cinder-76810 Jun 29 08:11:27.041620 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [req-48310e03-5df9-4b09-901f-e9eef01bac52 req-85b6b404-6a0b-4166-ae4c-f694ad6e1bbe service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057106 Jun 29 08:11:27.042499 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 463/917] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jun 29 08:11:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:11:27.301467 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-670aa5c7-9974-4e37-b166-0bdee34d6e8f tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:11:27.302091 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-670aa5c7-9974-4e37-b166-0bdee34d6e8f tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] [instance: 01330f68-42df-4986-b996-e6403d1555c6] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:11:27.312415 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-670aa5c7-9974-4e37-b166-0bdee34d6e8f tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:11:27.312795 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-670aa5c7-9974-4e37-b166-0bdee34d6e8f tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:11:27.313608 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-670aa5c7-9974-4e37-b166-0bdee34d6e8f tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:11:27.314051 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-670aa5c7-9974-4e37-b166-0bdee34d6e8f tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:11:27.525709 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-670aa5c7-9974-4e37-b166-0bdee34d6e8f tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4873db0f2fbf4a77a617f2102a5ccfae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4df15f6a6dd45dab12d0b724076a23e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:11:27.537506 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-670aa5c7-9974-4e37-b166-0bdee34d6e8f tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] 10.222.0.43 "GET /compute/v2.1/servers/01330f68-42df-4986-b996-e6403d1555c6" status: 200 len: 1365 microversion: 2.1 time: 0.240374 Jun 29 08:11:27.538830 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 455/918] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:11:27 2022] GET /compute/v2.1/servers/01330f68-42df-4986-b996-e6403d1555c6 => generated 1365 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:11:28.564598 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-5333f61c-d747-47f1-a839-2dd271c0ff8b tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:11:28.565356 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-5333f61c-d747-47f1-a839-2dd271c0ff8b tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] [instance: 01330f68-42df-4986-b996-e6403d1555c6] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:11:28.573316 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-5333f61c-d747-47f1-a839-2dd271c0ff8b tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:11:28.573630 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-5333f61c-d747-47f1-a839-2dd271c0ff8b tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:11:28.574410 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-5333f61c-d747-47f1-a839-2dd271c0ff8b tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:11:28.574851 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-5333f61c-d747-47f1-a839-2dd271c0ff8b tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:11:28.834768 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-5333f61c-d747-47f1-a839-2dd271c0ff8b tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4873db0f2fbf4a77a617f2102a5ccfae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4df15f6a6dd45dab12d0b724076a23e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:11:28.844339 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-5333f61c-d747-47f1-a839-2dd271c0ff8b tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] 10.222.0.43 "GET /compute/v2.1/servers/01330f68-42df-4986-b996-e6403d1555c6" status: 200 len: 1555 microversion: 2.1 time: 0.284054 Jun 29 08:11:28.857541 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 464/919] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:11:28 2022] GET /compute/v2.1/servers/01330f68-42df-4986-b996-e6403d1555c6 => generated 1555 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:11:28.865314 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-44c8a229-0224-431b-9516-5d41162d76fb tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:11:28.865314 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-44c8a229-0224-431b-9516-5d41162d76fb tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] [instance: 01330f68-42df-4986-b996-e6403d1555c6] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:11:28.875399 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-44c8a229-0224-431b-9516-5d41162d76fb tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:11:28.876243 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-44c8a229-0224-431b-9516-5d41162d76fb tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:11:28.877646 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-44c8a229-0224-431b-9516-5d41162d76fb tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:11:28.878113 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-44c8a229-0224-431b-9516-5d41162d76fb tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:11:29.034610 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-44c8a229-0224-431b-9516-5d41162d76fb tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] 10.222.0.43 "GET /compute/v2.1/servers/01330f68-42df-4986-b996-e6403d1555c6/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.174299 Jun 29 08:11:29.035855 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 456/920] 10.222.0.43 () {58 vars in 1274 bytes} [Wed Jun 29 08:11:28 2022] GET /compute/v2.1/servers/01330f68-42df-4986-b996-e6403d1555c6/os-interface => generated 285 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 29 08:11:30.653108 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [req-65394d0b-ade4-4976-a8a7-e19e7bf0157b req-2e71b8e7-75f6-4cf7-9695-5827869ce89d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "01330f68-42df-4986-b996-e6403d1555c6", "tag": "46cb7d49-04c0-46a7-8dd7-77f912b18d6d"}]} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:11:30.666643 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-65394d0b-ade4-4976-a8a7-e19e7bf0157b req-2e71b8e7-75f6-4cf7-9695-5827869ce89d service nova] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:11:30.674269 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-65394d0b-ade4-4976-a8a7-e19e7bf0157b req-2e71b8e7-75f6-4cf7-9695-5827869ce89d service nova] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:11:30.707046 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.compute.server_external_events [req-65394d0b-ade4-4976-a8a7-e19e7bf0157b req-2e71b8e7-75f6-4cf7-9695-5827869ce89d service nova] Creating event network-changed:46cb7d49-04c0-46a7-8dd7-77f912b18d6d for instance 01330f68-42df-4986-b996-e6403d1555c6 on hv-cinder-76810 Jun 29 08:11:30.721246 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [req-65394d0b-ade4-4976-a8a7-e19e7bf0157b req-2e71b8e7-75f6-4cf7-9695-5827869ce89d service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072898 Jun 29 08:11:30.721880 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 465/921] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jun 29 08:11:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:12:05.471809 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG dbcounter [-] [117890] Writing DB stats nova_api:SELECT=14,nova_api:DELETE=1 {{(pid=117890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:12:05.472658 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG dbcounter [-] [117890] Writing DB stats nova_cell1:SELECT=25 {{(pid=117890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:12:05.477019 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-3a9f56fa-3b3b-43aa-bf75-3da9ca012edb tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:12:05.477516 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-3a9f56fa-3b3b-43aa-bf75-3da9ca012edb tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] [instance: 01330f68-42df-4986-b996-e6403d1555c6] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:12:05.485360 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-3a9f56fa-3b3b-43aa-bf75-3da9ca012edb tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:12:05.485819 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-3a9f56fa-3b3b-43aa-bf75-3da9ca012edb tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:12:05.486606 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-3a9f56fa-3b3b-43aa-bf75-3da9ca012edb tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:12:05.487043 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-3a9f56fa-3b3b-43aa-bf75-3da9ca012edb tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:12:05.512100 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-3a9f56fa-3b3b-43aa-bf75-3da9ca012edb tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] 10.222.0.43 "GET /compute/v2.1/servers/01330f68-42df-4986-b996-e6403d1555c6/ips" status: 200 len: 150 microversion: 2.1 time: 0.041917 Jun 29 08:12:05.512665 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 457/922] 10.222.0.43 () {58 vars in 1247 bytes} [Wed Jun 29 08:12:05 2022] GET /compute/v2.1/servers/01330f68-42df-4986-b996-e6403d1555c6/ips => generated 150 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:12:06.835279 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_api:SELECT=11 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:12:06.836007 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_cell1:SELECT=36 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:12:06.840472 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-b5377fc6-e3ad-4fcf-b26e-82948e369bd1 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f8c95175-6ec2-493b-b300-6429efddfe43"}} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:12:06.841635 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-b5377fc6-e3ad-4fcf-b26e-82948e369bd1 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] [instance: 01330f68-42df-4986-b996-e6403d1555c6] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:12:06.848605 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-b5377fc6-e3ad-4fcf-b26e-82948e369bd1 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:12:06.849087 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-b5377fc6-e3ad-4fcf-b26e-82948e369bd1 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:12:06.849862 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-b5377fc6-e3ad-4fcf-b26e-82948e369bd1 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:12:06.850320 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-b5377fc6-e3ad-4fcf-b26e-82948e369bd1 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:12:07.117417 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-b5377fc6-e3ad-4fcf-b26e-82948e369bd1 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] 10.222.0.43 "POST /compute/v2.1/servers/01330f68-42df-4986-b996-e6403d1555c6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.283682 Jun 29 08:12:07.118027 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 466/923] 10.222.0.43 () {60 vars in 1322 bytes} [Wed Jun 29 08:12:06 2022] POST /compute/v2.1/servers/01330f68-42df-4986-b996-e6403d1555c6/os-volume_attachments => generated 194 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:12:14.630867 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-0d8b12ed-2a40-4d03-8fad-92c0db8801ed tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f8c95175-6ec2-493b-b300-6429efddfe43"}} {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:12:14.631926 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-0d8b12ed-2a40-4d03-8fad-92c0db8801ed tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] [instance: 01330f68-42df-4986-b996-e6403d1555c6] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:12:14.638622 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-0d8b12ed-2a40-4d03-8fad-92c0db8801ed tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:12:14.639066 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-0d8b12ed-2a40-4d03-8fad-92c0db8801ed tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:12:14.639843 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-0d8b12ed-2a40-4d03-8fad-92c0db8801ed tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:12:14.640276 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-0d8b12ed-2a40-4d03-8fad-92c0db8801ed tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:12:14.727637 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.wsgi [None req-0d8b12ed-2a40-4d03-8fad-92c0db8801ed tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] HTTP exception thrown: Invalid volume: volume f8c95175-6ec2-493b-b300-6429efddfe43 is already attached to instances: 01330f68-42df-4986-b996-e6403d1555c6 Jun 29 08:12:14.729489 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-0d8b12ed-2a40-4d03-8fad-92c0db8801ed tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Request method failure captured: Jun 29 08:12:14.729489 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: request: POST /compute/v2.1/servers/01330f68-42df-4986-b996-e6403d1555c6/os-volume_attachments HTTP/1.1 Jun 29 08:12:14.729489 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: Accept: application/json Jun 29 08:12:14.729489 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: Accept-Encoding: identity Jun 29 08:12:14.729489 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: Connection: close Jun 29 08:12:14.729489 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: Content-Length: 74 Jun 29 08:12:14.729489 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: Content-Type: application/json Jun 29 08:12:14.729489 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: Host: 10.222.0.43 Jun 29 08:12:14.729489 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: Openstack-System-Scope: None Jun 29 08:12:14.729489 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: User-Agent: python-urllib3/1.26.9 Jun 29 08:12:14.729489 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Auth-Token: gAAAAABivAiYnWOqjiwHcE1PCPUmCrIvEMkbVX7lWZxh9jPOZ_GtAOja07fGzXFEXqZ7Ky0xacgV6SGsTaq5tzX8bh-ZG0acOi-203kWLHdiaJ2wslMtHKMClYhsYgyOgs9fcpZ5v5SN8dlG-3pGiAd5z4Hj9kmL7TX1CMp1QfZwI7CaxfijbC4 Jun 29 08:12:14.729489 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Domain-Id: None Jun 29 08:12:14.729489 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Domain-Name: None Jun 29 08:12:14.729489 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Identity-Status: Confirmed Jun 29 08:12:14.729489 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Is-Admin-Project: True Jun 29 08:12:14.729489 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Project-Domain-Id: default Jun 29 08:12:14.729489 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Project-Domain-Name: Default Jun 29 08:12:14.729489 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Project-Id: a4df15f6a6dd45dab12d0b724076a23e Jun 29 08:12:14.729489 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Project-Name: tempest-AttachVolumeNegativeTest-471433960 Jun 29 08:12:14.729489 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Role: member,reader Jun 29 08:12:14.729489 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Roles: member,reader Jun 29 08:12:14.731385 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a4df15f6a6dd45dab12d0b724076a23e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_a4df15f6a6dd45dab12d0b724076a23e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a4df15f6a6dd45dab12d0b724076a23e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/a4df15f6a6dd45dab12d0b724076a23e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Jun 29 08:12:14.731385 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Tenant: tempest-AttachVolumeNegativeTest-471433960 Jun 29 08:12:14.731385 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Tenant-Id: a4df15f6a6dd45dab12d0b724076a23e Jun 29 08:12:14.731385 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-471433960 Jun 29 08:12:14.731385 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-User: tempest-AttachVolumeNegativeTest-471433960-project Jun 29 08:12:14.731385 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-User-Domain-Id: default Jun 29 08:12:14.731385 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-User-Domain-Name: Default Jun 29 08:12:14.731385 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-User-Id: 4873db0f2fbf4a77a617f2102a5ccfae Jun 29 08:12:14.731385 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-User-Name: tempest-AttachVolumeNegativeTest-471433960-project Jun 29 08:12:14.731385 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: Jun 29 08:12:14.731385 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: {"volumeAttachment": {"volumeId": "f8c95175-6ec2-493b-b300-6429efddfe43"}} Jun 29 08:12:14.731385 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: method: > Jun 29 08:12:14.732344 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: exception: Invalid volume: volume f8c95175-6ec2-493b-b300-6429efddfe43 is already attached to instances: 01330f68-42df-4986-b996-e6403d1555c6 Jun 29 08:12:14.732344 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: action_args: {'server_id': '01330f68-42df-4986-b996-e6403d1555c6', 'body': {'volumeAttachment': {'volumeId': 'f8c95175-6ec2-493b-b300-6429efddfe43'}}} Jun 29 08:12:14.732344 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 08:12:14.732344 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:12:14.732344 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 29 08:12:14.732344 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 29 08:12:14.732344 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 29 08:12:14.732344 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 29 08:12:14.732344 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 29 08:12:14.732344 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 29 08:12:14.732344 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 29 08:12:14.732344 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 29 08:12:14.732344 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 29 08:12:14.732344 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 29 08:12:14.732344 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume f8c95175-6ec2-493b-b300-6429efddfe43 is already attached to instances: 01330f68-42df-4986-b996-e6403d1555c6 Jun 29 08:12:14.732344 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 29 08:12:14.732344 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 08:12:14.732344 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 29 08:12:14.732344 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:12:14.733978 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 08:12:14.733978 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 08:12:14.733978 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 08:12:14.733978 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 08:12:14.733978 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 08:12:14.733978 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 08:12:14.733978 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 29 08:12:14.733978 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 29 08:12:14.733978 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 29 08:12:14.733978 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 29 08:12:14.733978 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 29 08:12:14.733978 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 29 08:12:14.733978 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 29 08:12:14.733978 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 29 08:12:14.733978 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume f8c95175-6ec2-493b-b300-6429efddfe43 is already attached to instances: 01330f68-42df-4986-b996-e6403d1555c6 Jun 29 08:12:14.733978 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 29 08:12:14.733978 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 08:12:14.733978 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 29 08:12:14.733978 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:12:14.733978 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 08:12:14.736289 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 08:12:14.736289 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 08:12:14.736289 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 08:12:14.736289 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume f8c95175-6ec2-493b-b300-6429efddfe43 is already attached to instances: 01330f68-42df-4986-b996-e6403d1555c6 Jun 29 08:12:14.736289 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 29 08:12:14.736289 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-0d8b12ed-2a40-4d03-8fad-92c0db8801ed tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Returning 400 to user: Invalid volume: volume f8c95175-6ec2-493b-b300-6429efddfe43 is already attached to instances: 01330f68-42df-4986-b996-e6403d1555c6 {{(pid=117890) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 08:12:14.736289 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-0d8b12ed-2a40-4d03-8fad-92c0db8801ed tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] 10.222.0.43 "POST /compute/v2.1/servers/01330f68-42df-4986-b996-e6403d1555c6/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.104168 Jun 29 08:12:14.736289 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 458/924] 10.222.0.43 () {60 vars in 1322 bytes} [Wed Jun 29 08:12:14 2022] POST /compute/v2.1/servers/01330f68-42df-4986-b996-e6403d1555c6/os-volume_attachments => generated 174 bytes in 106 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 29 08:12:14.801386 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-717429b8-40a7-456f-9302-d7eb665a0d8b tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:12:14.801988 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-717429b8-40a7-456f-9302-d7eb665a0d8b tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] [instance: 01330f68-42df-4986-b996-e6403d1555c6] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:12:14.808415 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-717429b8-40a7-456f-9302-d7eb665a0d8b tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:12:14.808859 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-717429b8-40a7-456f-9302-d7eb665a0d8b tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:12:14.809654 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-717429b8-40a7-456f-9302-d7eb665a0d8b tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:12:14.810088 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-717429b8-40a7-456f-9302-d7eb665a0d8b tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:12:14.894669 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.objects.instance [None req-717429b8-40a7-456f-9302-d7eb665a0d8b tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lazy-loading 'services' on Instance uuid 01330f68-42df-4986-b996-e6403d1555c6 {{(pid=117889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 29 08:12:14.975931 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-717429b8-40a7-456f-9302-d7eb665a0d8b tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] 10.222.0.43 "DELETE /compute/v2.1/servers/01330f68-42df-4986-b996-e6403d1555c6/os-volume_attachments/f8c95175-6ec2-493b-b300-6429efddfe43" status: 202 len: 0 microversion: 2.1 time: 0.180154 Jun 29 08:12:14.976521 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 467/925] 10.222.0.43 () {58 vars in 1415 bytes} [Wed Jun 29 08:12:14 2022] DELETE /compute/v2.1/servers/01330f68-42df-4986-b996-e6403d1555c6/os-volume_attachments/f8c95175-6ec2-493b-b300-6429efddfe43 => generated 0 bytes in 182 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 29 08:12:14.985490 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-061af245-03f4-4127-abca-412171cc6b05 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:12:14.986822 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-061af245-03f4-4127-abca-412171cc6b05 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] [instance: 01330f68-42df-4986-b996-e6403d1555c6] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:12:14.995481 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-061af245-03f4-4127-abca-412171cc6b05 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:12:14.996282 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-061af245-03f4-4127-abca-412171cc6b05 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:12:14.997335 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-061af245-03f4-4127-abca-412171cc6b05 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:12:14.997784 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-061af245-03f4-4127-abca-412171cc6b05 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:12:15.033538 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-061af245-03f4-4127-abca-412171cc6b05 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] 10.222.0.43 "GET /compute/v2.1/servers/01330f68-42df-4986-b996-e6403d1555c6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052309 Jun 29 08:12:15.034046 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 459/926] 10.222.0.43 () {58 vars in 1301 bytes} [Wed Jun 29 08:12:14 2022] GET /compute/v2.1/servers/01330f68-42df-4986-b996-e6403d1555c6/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:12:16.046894 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-dce3653d-5b55-4b61-81d9-a3073a637e7f tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:12:16.048018 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-dce3653d-5b55-4b61-81d9-a3073a637e7f tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] [instance: 01330f68-42df-4986-b996-e6403d1555c6] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:12:16.054792 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-dce3653d-5b55-4b61-81d9-a3073a637e7f tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:12:16.055299 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-dce3653d-5b55-4b61-81d9-a3073a637e7f tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:12:16.056010 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-dce3653d-5b55-4b61-81d9-a3073a637e7f tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:12:16.056441 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-dce3653d-5b55-4b61-81d9-a3073a637e7f tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:12:16.088140 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-dce3653d-5b55-4b61-81d9-a3073a637e7f tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] 10.222.0.43 "GET /compute/v2.1/servers/01330f68-42df-4986-b996-e6403d1555c6/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046266 Jun 29 08:12:16.088816 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 468/927] 10.222.0.43 () {58 vars in 1301 bytes} [Wed Jun 29 08:12:16 2022] GET /compute/v2.1/servers/01330f68-42df-4986-b996-e6403d1555c6/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 29 08:12:16.150013 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-2d26adfd-77f4-4c15-b816-c59c07da38a1 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:12:16.150869 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-2d26adfd-77f4-4c15-b816-c59c07da38a1 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] [instance: 01330f68-42df-4986-b996-e6403d1555c6] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:12:16.157714 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-2d26adfd-77f4-4c15-b816-c59c07da38a1 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:12:16.158403 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-2d26adfd-77f4-4c15-b816-c59c07da38a1 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:12:16.159408 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-2d26adfd-77f4-4c15-b816-c59c07da38a1 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:12:16.159958 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-2d26adfd-77f4-4c15-b816-c59c07da38a1 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:12:16.190288 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-2d26adfd-77f4-4c15-b816-c59c07da38a1 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] [instance: 01330f68-42df-4986-b996-e6403d1555c6] Going to try to terminate instance {{(pid=117890) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 29 08:12:16.283178 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-2d26adfd-77f4-4c15-b816-c59c07da38a1 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] 10.222.0.43 "DELETE /compute/v2.1/servers/01330f68-42df-4986-b996-e6403d1555c6" status: 204 len: 0 microversion: 2.1 time: 0.136873 Jun 29 08:12:16.283828 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 460/928] 10.222.0.43 () {58 vars in 1238 bytes} [Wed Jun 29 08:12:16 2022] DELETE /compute/v2.1/servers/01330f68-42df-4986-b996-e6403d1555c6 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 29 08:12:16.293164 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-0662a3e4-1dd8-45c1-9578-03cbb581a818 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:12:16.293919 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-0662a3e4-1dd8-45c1-9578-03cbb581a818 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] [instance: 01330f68-42df-4986-b996-e6403d1555c6] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:12:16.304075 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-0662a3e4-1dd8-45c1-9578-03cbb581a818 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:12:16.305407 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-0662a3e4-1dd8-45c1-9578-03cbb581a818 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:12:16.307075 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-0662a3e4-1dd8-45c1-9578-03cbb581a818 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:12:16.308069 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-0662a3e4-1dd8-45c1-9578-03cbb581a818 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:12:16.455148 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-0662a3e4-1dd8-45c1-9578-03cbb581a818 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4873db0f2fbf4a77a617f2102a5ccfae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4df15f6a6dd45dab12d0b724076a23e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:12:16.463150 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-0662a3e4-1dd8-45c1-9578-03cbb581a818 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] 10.222.0.43 "GET /compute/v2.1/servers/01330f68-42df-4986-b996-e6403d1555c6" status: 200 len: 1680 microversion: 2.1 time: 0.174323 Jun 29 08:12:16.463739 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 469/929] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:12:16 2022] GET /compute/v2.1/servers/01330f68-42df-4986-b996-e6403d1555c6 => generated 1680 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:12:17.487411 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-9934ce2a-9d8d-40ab-8e7e-990df2fd2d5e tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:12:17.488813 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-9934ce2a-9d8d-40ab-8e7e-990df2fd2d5e tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] [instance: 01330f68-42df-4986-b996-e6403d1555c6] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:12:17.496092 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-9934ce2a-9d8d-40ab-8e7e-990df2fd2d5e tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:12:17.496546 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-9934ce2a-9d8d-40ab-8e7e-990df2fd2d5e tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:12:17.497365 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-9934ce2a-9d8d-40ab-8e7e-990df2fd2d5e tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:12:17.497807 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-9934ce2a-9d8d-40ab-8e7e-990df2fd2d5e tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:12:17.647103 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-9934ce2a-9d8d-40ab-8e7e-990df2fd2d5e tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4873db0f2fbf4a77a617f2102a5ccfae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4df15f6a6dd45dab12d0b724076a23e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:12:17.657091 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-9934ce2a-9d8d-40ab-8e7e-990df2fd2d5e tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] 10.222.0.43 "GET /compute/v2.1/servers/01330f68-42df-4986-b996-e6403d1555c6" status: 200 len: 1680 microversion: 2.1 time: 0.174127 Jun 29 08:12:17.657872 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 461/930] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:12:17 2022] GET /compute/v2.1/servers/01330f68-42df-4986-b996-e6403d1555c6 => generated 1680 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:12:18.675283 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-cdcabaab-236e-4878-ac42-2237f356d87b tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:12:18.676349 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-cdcabaab-236e-4878-ac42-2237f356d87b tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] [instance: 01330f68-42df-4986-b996-e6403d1555c6] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:12:18.683912 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-cdcabaab-236e-4878-ac42-2237f356d87b tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:12:18.683912 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-cdcabaab-236e-4878-ac42-2237f356d87b tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:12:18.684705 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-cdcabaab-236e-4878-ac42-2237f356d87b tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:12:18.685173 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-cdcabaab-236e-4878-ac42-2237f356d87b tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:12:18.751898 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-cdcabaab-236e-4878-ac42-2237f356d87b tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4873db0f2fbf4a77a617f2102a5ccfae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4df15f6a6dd45dab12d0b724076a23e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:12:18.766410 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-cdcabaab-236e-4878-ac42-2237f356d87b tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] 10.222.0.43 "GET /compute/v2.1/servers/01330f68-42df-4986-b996-e6403d1555c6" status: 200 len: 1612 microversion: 2.1 time: 0.095770 Jun 29 08:12:18.767031 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 470/931] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:12:18 2022] GET /compute/v2.1/servers/01330f68-42df-4986-b996-e6403d1555c6 => generated 1612 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:12:18.903444 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [req-86a867f0-b324-4439-a714-009c918d501f req-56a7aae2-b08b-4754-8e8c-64d615994630 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "01330f68-42df-4986-b996-e6403d1555c6", "name": "network-vif-deleted", "tag": "46cb7d49-04c0-46a7-8dd7-77f912b18d6d"}]} {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:12:18.919690 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [req-86a867f0-b324-4439-a714-009c918d501f req-56a7aae2-b08b-4754-8e8c-64d615994630 service nova] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:12:18.920496 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [req-86a867f0-b324-4439-a714-009c918d501f req-56a7aae2-b08b-4754-8e8c-64d615994630 service nova] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:12:18.935027 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.compute.server_external_events [req-86a867f0-b324-4439-a714-009c918d501f req-56a7aae2-b08b-4754-8e8c-64d615994630 service nova] Creating event network-vif-deleted:46cb7d49-04c0-46a7-8dd7-77f912b18d6d for instance 01330f68-42df-4986-b996-e6403d1555c6 on hv-cinder-76810 Jun 29 08:12:18.943488 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [req-86a867f0-b324-4439-a714-009c918d501f req-56a7aae2-b08b-4754-8e8c-64d615994630 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049263 Jun 29 08:12:18.944416 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 462/932] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jun 29 08:12:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:12:19.789593 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-f570c6d3-b719-4621-a5b0-8a47609b8b82 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:12:19.790305 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-f570c6d3-b719-4621-a5b0-8a47609b8b82 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] [instance: 01330f68-42df-4986-b996-e6403d1555c6] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:12:19.797202 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-f570c6d3-b719-4621-a5b0-8a47609b8b82 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:12:19.798034 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-f570c6d3-b719-4621-a5b0-8a47609b8b82 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:12:19.798533 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-f570c6d3-b719-4621-a5b0-8a47609b8b82 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:12:19.798964 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-f570c6d3-b719-4621-a5b0-8a47609b8b82 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:12:19.814380 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.wsgi [None req-f570c6d3-b719-4621-a5b0-8a47609b8b82 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] HTTP exception thrown: Instance 01330f68-42df-4986-b996-e6403d1555c6 could not be found. Jun 29 08:12:19.816149 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-f570c6d3-b719-4621-a5b0-8a47609b8b82 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Request method failure captured: Jun 29 08:12:19.816149 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: request: GET /compute/v2.1/servers/01330f68-42df-4986-b996-e6403d1555c6 HTTP/1.1 Jun 29 08:12:19.816149 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: Accept: application/json Jun 29 08:12:19.816149 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: Accept-Encoding: identity Jun 29 08:12:19.816149 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: Connection: close Jun 29 08:12:19.816149 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: Content-Length: 0 Jun 29 08:12:19.816149 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: Content-Type: application/json Jun 29 08:12:19.816149 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: Host: 10.222.0.43 Jun 29 08:12:19.816149 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: Openstack-System-Scope: None Jun 29 08:12:19.816149 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: User-Agent: python-urllib3/1.26.9 Jun 29 08:12:19.816149 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Auth-Token: gAAAAABivAiYnWOqjiwHcE1PCPUmCrIvEMkbVX7lWZxh9jPOZ_GtAOja07fGzXFEXqZ7Ky0xacgV6SGsTaq5tzX8bh-ZG0acOi-203kWLHdiaJ2wslMtHKMClYhsYgyOgs9fcpZ5v5SN8dlG-3pGiAd5z4Hj9kmL7TX1CMp1QfZwI7CaxfijbC4 Jun 29 08:12:19.816149 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Domain-Id: None Jun 29 08:12:19.816149 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Domain-Name: None Jun 29 08:12:19.816149 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Identity-Status: Confirmed Jun 29 08:12:19.816149 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Is-Admin-Project: True Jun 29 08:12:19.816149 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Project-Domain-Id: default Jun 29 08:12:19.816149 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Project-Domain-Name: Default Jun 29 08:12:19.816149 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Project-Id: a4df15f6a6dd45dab12d0b724076a23e Jun 29 08:12:19.816149 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Project-Name: tempest-AttachVolumeNegativeTest-471433960 Jun 29 08:12:19.816149 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Role: member,reader Jun 29 08:12:19.816149 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Roles: member,reader Jun 29 08:12:19.817838 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a4df15f6a6dd45dab12d0b724076a23e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_a4df15f6a6dd45dab12d0b724076a23e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a4df15f6a6dd45dab12d0b724076a23e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/a4df15f6a6dd45dab12d0b724076a23e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Jun 29 08:12:19.817838 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Tenant: tempest-AttachVolumeNegativeTest-471433960 Jun 29 08:12:19.817838 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Tenant-Id: a4df15f6a6dd45dab12d0b724076a23e Jun 29 08:12:19.817838 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-471433960 Jun 29 08:12:19.817838 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-User: tempest-AttachVolumeNegativeTest-471433960-project Jun 29 08:12:19.817838 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-User-Domain-Id: default Jun 29 08:12:19.817838 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-User-Domain-Name: Default Jun 29 08:12:19.817838 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-User-Id: 4873db0f2fbf4a77a617f2102a5ccfae Jun 29 08:12:19.817838 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-User-Name: tempest-AttachVolumeNegativeTest-471433960-project Jun 29 08:12:19.817838 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: method: > Jun 29 08:12:19.817838 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: exception: Instance 01330f68-42df-4986-b996-e6403d1555c6 could not be found. Jun 29 08:12:19.817838 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: action_args: {'id': '01330f68-42df-4986-b996-e6403d1555c6'} Jun 29 08:12:19.818741 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 08:12:19.818741 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:12:19.818741 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 29 08:12:19.818741 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 29 08:12:19.818741 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 29 08:12:19.818741 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 29 08:12:19.818741 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 29 08:12:19.818741 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 29 08:12:19.818741 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 29 08:12:19.818741 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 29 08:12:19.818741 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 01330f68-42df-4986-b996-e6403d1555c6 could not be found. Jun 29 08:12:19.818741 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 29 08:12:19.818741 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 08:12:19.818741 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 29 08:12:19.818741 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:12:19.818741 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 08:12:19.818741 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 08:12:19.818741 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 08:12:19.818741 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 08:12:19.818741 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 08:12:19.820282 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 08:12:19.820282 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 29 08:12:19.820282 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 29 08:12:19.820282 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 29 08:12:19.820282 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 29 08:12:19.820282 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 29 08:12:19.820282 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 29 08:12:19.820282 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 01330f68-42df-4986-b996-e6403d1555c6 could not be found. Jun 29 08:12:19.820282 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 29 08:12:19.820282 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 08:12:19.820282 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 29 08:12:19.820282 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:12:19.820282 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 08:12:19.820282 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 08:12:19.820282 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 08:12:19.820282 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 08:12:19.820282 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 01330f68-42df-4986-b996-e6403d1555c6 could not be found. Jun 29 08:12:19.820282 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 29 08:12:19.821988 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-f570c6d3-b719-4621-a5b0-8a47609b8b82 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Returning 404 to user: Instance 01330f68-42df-4986-b996-e6403d1555c6 could not be found. {{(pid=117889) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 08:12:19.821988 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-f570c6d3-b719-4621-a5b0-8a47609b8b82 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] 10.222.0.43 "GET /compute/v2.1/servers/01330f68-42df-4986-b996-e6403d1555c6" status: 404 len: 111 microversion: 2.1 time: 0.031943 Jun 29 08:12:19.821988 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 471/933] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:12:19 2022] GET /compute/v2.1/servers/01330f68-42df-4986-b996-e6403d1555c6 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 29 08:12:19.827120 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-e9179e33-59e7-4270-92d9-398d69b7187b tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Calling method '.version_select at 0x7f7241377670>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:12:19.846915 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-e9179e33-59e7-4270-92d9-398d69b7187b tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-925894846" status: 202 len: 0 microversion: 2.1 time: 0.023961 Jun 29 08:12:19.847602 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 463/934] 10.222.0.43 () {58 vars in 1217 bytes} [Wed Jun 29 08:12:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-925894846 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 29 08:12:20.557786 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-254fabd0-ae60-4574-8afd-455f4f78593e tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Action: 'create', calling method: .version_select at 0x7f7241141e50>, body: {"keypair": {"name": "tempest-keypair-594512687", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO/6FXKgK7xV283Nfsr6BQNzjbTEN2FOuMXlzPPBcxJ6FreQRH71pHAQLsK/aFFKSH4WOGyrt1uNqiDdN00GUgINIh/pJ8buqiD52/BBIKB/1O7m5od2JxPMzQlyfVRgdA=="}} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:12:20.572670 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.quota [None req-254fabd0-ae60-4574-8afd-455f4f78593e tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Getting quotas for project a4df15f6a6dd45dab12d0b724076a23e. Resources: {'key_pairs'} {{(pid=117889) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 29 08:12:20.576824 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.quota [None req-254fabd0-ae60-4574-8afd-455f4f78593e tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Getting quotas for user 4873db0f2fbf4a77a617f2102a5ccfae and project a4df15f6a6dd45dab12d0b724076a23e. Resources: {'key_pairs'} {{(pid=117889) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 29 08:12:20.603223 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-254fabd0-ae60-4574-8afd-455f4f78593e tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.049334 Jun 29 08:12:20.603826 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 472/935] 10.222.0.43 () {60 vars in 1158 bytes} [Wed Jun 29 08:12:20 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:12:21.894638 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-3ecf9bc4-e26d-411d-b939-bb5313b86c06 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1428305090", "imageRef": "5d2148a0-3628-4eff-88e9-5686abc0d33e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "501bffb4-f18b-4ba3-b604-4fd9c7554413"}], "security_groups": [{"name": "tempest-securitygroup--1602537036"}], "key_name": "tempest-keypair-594512687", "user_data": "}} {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:12:22.003869 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.network.neutron [None req-3ecf9bc4-e26d-411d-b939-bb5313b86c06 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] validate_networks() for [('501bffb4-f18b-4ba3-b604-4fd9c7554413', None, None, None, None, None)] {{(pid=117890) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 29 08:12:22.405210 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.virt.hardware [None req-3ecf9bc4-e26d-411d-b939-bb5313b86c06 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Flavor limits 0:0:0 {{(pid=117890) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 29 08:12:22.405639 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.virt.hardware [None req-3ecf9bc4-e26d-411d-b939-bb5313b86c06 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Image limits 0:0:0 {{(pid=117890) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 29 08:12:22.406115 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.virt.hardware [None req-3ecf9bc4-e26d-411d-b939-bb5313b86c06 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Flavor pref 0:0:0 {{(pid=117890) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 29 08:12:22.406541 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.virt.hardware [None req-3ecf9bc4-e26d-411d-b939-bb5313b86c06 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Image pref 0:0:0 {{(pid=117890) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 29 08:12:22.407537 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.virt.hardware [None req-3ecf9bc4-e26d-411d-b939-bb5313b86c06 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117890) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 29 08:12:22.416625 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-3ecf9bc4-e26d-411d-b939-bb5313b86c06 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:12:22.417108 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-3ecf9bc4-e26d-411d-b939-bb5313b86c06 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:12:22.417918 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-3ecf9bc4-e26d-411d-b939-bb5313b86c06 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:12:22.418347 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-3ecf9bc4-e26d-411d-b939-bb5313b86c06 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:12:22.437238 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.quota [None req-3ecf9bc4-e26d-411d-b939-bb5313b86c06 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Getting quotas for project a4df15f6a6dd45dab12d0b724076a23e. Resources: {'ram', 'instances', 'cores'} {{(pid=117890) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 29 08:12:22.442684 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.quota [None req-3ecf9bc4-e26d-411d-b939-bb5313b86c06 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Getting quotas for user 4873db0f2fbf4a77a617f2102a5ccfae and project a4df15f6a6dd45dab12d0b724076a23e. Resources: {'ram', 'instances', 'cores'} {{(pid=117890) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 29 08:12:22.455119 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-3ecf9bc4-e26d-411d-b939-bb5313b86c06 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Going to run 1 instances... {{(pid=117890) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 29 08:12:22.457676 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-3ecf9bc4-e26d-411d-b939-bb5313b86c06 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] [instance: a801a87e-5f0e-4158-8961-e30899677422] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5d2148a0-3628-4eff-88e9-5686abc0d33e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117890) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 29 08:12:22.506835 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-3ecf9bc4-e26d-411d-b939-bb5313b86c06 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.617128 Jun 29 08:12:22.507488 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 464/936] 10.222.0.43 () {60 vars in 1146 bytes} [Wed Jun 29 08:12:21 2022] POST /compute/v2.1/servers => generated 402 bytes in 618 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 29 08:12:22.518246 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-83c334b4-60ba-489b-a149-ac8050cde9b9 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:12:22.518871 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-83c334b4-60ba-489b-a149-ac8050cde9b9 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] [instance: a801a87e-5f0e-4158-8961-e30899677422] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:12:22.578108 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-83c334b4-60ba-489b-a149-ac8050cde9b9 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4873db0f2fbf4a77a617f2102a5ccfae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4df15f6a6dd45dab12d0b724076a23e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:12:22.586568 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-83c334b4-60ba-489b-a149-ac8050cde9b9 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] 10.222.0.43 "GET /compute/v2.1/servers/a801a87e-5f0e-4158-8961-e30899677422" status: 200 len: 1241 microversion: 2.1 time: 0.072761 Jun 29 08:12:22.587138 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 473/937] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:12:22 2022] GET /compute/v2.1/servers/a801a87e-5f0e-4158-8961-e30899677422 => generated 1241 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:12:23.605292 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-38f58e07-a160-4253-90aa-76565a70e751 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:12:23.607211 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-38f58e07-a160-4253-90aa-76565a70e751 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] [instance: a801a87e-5f0e-4158-8961-e30899677422] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:12:23.617301 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-38f58e07-a160-4253-90aa-76565a70e751 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:12:23.617747 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-38f58e07-a160-4253-90aa-76565a70e751 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:12:23.618537 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-38f58e07-a160-4253-90aa-76565a70e751 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:12:23.618971 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-38f58e07-a160-4253-90aa-76565a70e751 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:12:23.702951 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-38f58e07-a160-4253-90aa-76565a70e751 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4873db0f2fbf4a77a617f2102a5ccfae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4df15f6a6dd45dab12d0b724076a23e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:12:23.712135 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-38f58e07-a160-4253-90aa-76565a70e751 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] 10.222.0.43 "GET /compute/v2.1/servers/a801a87e-5f0e-4158-8961-e30899677422" status: 200 len: 1299 microversion: 2.1 time: 0.112026 Jun 29 08:12:23.712721 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 465/938] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:12:23 2022] GET /compute/v2.1/servers/a801a87e-5f0e-4158-8961-e30899677422 => generated 1299 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:12:24.730647 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-35ad76c3-7dfc-4b6d-833c-2e414caffa92 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:12:24.732046 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-35ad76c3-7dfc-4b6d-833c-2e414caffa92 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] [instance: a801a87e-5f0e-4158-8961-e30899677422] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:12:24.738890 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-35ad76c3-7dfc-4b6d-833c-2e414caffa92 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:12:24.739348 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-35ad76c3-7dfc-4b6d-833c-2e414caffa92 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:12:24.740126 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-35ad76c3-7dfc-4b6d-833c-2e414caffa92 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:12:24.740572 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-35ad76c3-7dfc-4b6d-833c-2e414caffa92 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:12:24.909039 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-35ad76c3-7dfc-4b6d-833c-2e414caffa92 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4873db0f2fbf4a77a617f2102a5ccfae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4df15f6a6dd45dab12d0b724076a23e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:12:24.919828 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-35ad76c3-7dfc-4b6d-833c-2e414caffa92 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] 10.222.0.43 "GET /compute/v2.1/servers/a801a87e-5f0e-4158-8961-e30899677422" status: 200 len: 1367 microversion: 2.1 time: 0.192868 Jun 29 08:12:24.930228 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 474/939] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:12:24 2022] GET /compute/v2.1/servers/a801a87e-5f0e-4158-8961-e30899677422 => generated 1367 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 08:12:25.071033 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [req-c035d260-210a-4728-818a-5ee286a668ed req-d9cf938a-5a09-4d54-bca1-a4f25747df20 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a801a87e-5f0e-4158-8961-e30899677422", "tag": "98a6c7dc-e52d-4148-91a3-dd6e54263a43"}]} {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:12:25.081062 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [req-c035d260-210a-4728-818a-5ee286a668ed req-d9cf938a-5a09-4d54-bca1-a4f25747df20 service nova] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:12:25.081926 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [req-c035d260-210a-4728-818a-5ee286a668ed req-d9cf938a-5a09-4d54-bca1-a4f25747df20 service nova] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:12:25.108779 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.compute.server_external_events [req-c035d260-210a-4728-818a-5ee286a668ed req-d9cf938a-5a09-4d54-bca1-a4f25747df20 service nova] Creating event network-changed:98a6c7dc-e52d-4148-91a3-dd6e54263a43 for instance a801a87e-5f0e-4158-8961-e30899677422 on hv-cinder-76810 Jun 29 08:12:25.124104 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [req-c035d260-210a-4728-818a-5ee286a668ed req-d9cf938a-5a09-4d54-bca1-a4f25747df20 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056551 Jun 29 08:12:25.124950 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 466/940] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jun 29 08:12:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:12:25.938758 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-70480bb4-cce6-4a8c-855d-fa598f636f85 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:12:25.939448 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-70480bb4-cce6-4a8c-855d-fa598f636f85 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] [instance: a801a87e-5f0e-4158-8961-e30899677422] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:12:25.946335 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-70480bb4-cce6-4a8c-855d-fa598f636f85 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:12:25.946788 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-70480bb4-cce6-4a8c-855d-fa598f636f85 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:12:25.947568 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-70480bb4-cce6-4a8c-855d-fa598f636f85 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:12:25.948004 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-70480bb4-cce6-4a8c-855d-fa598f636f85 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:12:26.091178 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-70480bb4-cce6-4a8c-855d-fa598f636f85 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4873db0f2fbf4a77a617f2102a5ccfae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4df15f6a6dd45dab12d0b724076a23e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:12:26.099198 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-70480bb4-cce6-4a8c-855d-fa598f636f85 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] 10.222.0.43 "GET /compute/v2.1/servers/a801a87e-5f0e-4158-8961-e30899677422" status: 200 len: 1367 microversion: 2.1 time: 0.164894 Jun 29 08:12:26.099783 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 475/941] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:12:25 2022] GET /compute/v2.1/servers/a801a87e-5f0e-4158-8961-e30899677422 => generated 1367 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 08:12:27.116275 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-507ca3cc-a411-4981-85c8-1a020129e4b7 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:12:27.116996 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-507ca3cc-a411-4981-85c8-1a020129e4b7 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] [instance: a801a87e-5f0e-4158-8961-e30899677422] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:12:27.123518 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-507ca3cc-a411-4981-85c8-1a020129e4b7 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:12:27.123979 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-507ca3cc-a411-4981-85c8-1a020129e4b7 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:12:27.124753 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-507ca3cc-a411-4981-85c8-1a020129e4b7 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:12:27.125225 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-507ca3cc-a411-4981-85c8-1a020129e4b7 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:12:27.496247 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-507ca3cc-a411-4981-85c8-1a020129e4b7 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4873db0f2fbf4a77a617f2102a5ccfae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4df15f6a6dd45dab12d0b724076a23e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:12:27.505101 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-507ca3cc-a411-4981-85c8-1a020129e4b7 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] 10.222.0.43 "GET /compute/v2.1/servers/a801a87e-5f0e-4158-8961-e30899677422" status: 200 len: 1367 microversion: 2.1 time: 0.393026 Jun 29 08:12:27.505674 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 467/942] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:12:27 2022] GET /compute/v2.1/servers/a801a87e-5f0e-4158-8961-e30899677422 => generated 1367 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:12:28.522725 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-9ac95f70-f9d3-455c-82eb-f2067c671df5 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:12:28.523810 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-9ac95f70-f9d3-455c-82eb-f2067c671df5 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] [instance: a801a87e-5f0e-4158-8961-e30899677422] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:12:28.531542 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-9ac95f70-f9d3-455c-82eb-f2067c671df5 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:12:28.532219 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-9ac95f70-f9d3-455c-82eb-f2067c671df5 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:12:28.533201 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-9ac95f70-f9d3-455c-82eb-f2067c671df5 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:12:28.533576 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-9ac95f70-f9d3-455c-82eb-f2067c671df5 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:12:28.677198 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-9ac95f70-f9d3-455c-82eb-f2067c671df5 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4873db0f2fbf4a77a617f2102a5ccfae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4df15f6a6dd45dab12d0b724076a23e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:12:28.685430 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-9ac95f70-f9d3-455c-82eb-f2067c671df5 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] 10.222.0.43 "GET /compute/v2.1/servers/a801a87e-5f0e-4158-8961-e30899677422" status: 200 len: 1367 microversion: 2.1 time: 0.166775 Jun 29 08:12:28.686010 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 476/943] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:12:28 2022] GET /compute/v2.1/servers/a801a87e-5f0e-4158-8961-e30899677422 => generated 1367 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:12:29.702385 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-e6fe824d-bbbe-4c4a-8c41-a14e82909498 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:12:29.703026 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-e6fe824d-bbbe-4c4a-8c41-a14e82909498 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] [instance: a801a87e-5f0e-4158-8961-e30899677422] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:12:29.710381 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-e6fe824d-bbbe-4c4a-8c41-a14e82909498 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:12:29.710827 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-e6fe824d-bbbe-4c4a-8c41-a14e82909498 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:12:29.711614 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-e6fe824d-bbbe-4c4a-8c41-a14e82909498 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:12:29.712047 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-e6fe824d-bbbe-4c4a-8c41-a14e82909498 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:12:29.847049 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-e6fe824d-bbbe-4c4a-8c41-a14e82909498 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4873db0f2fbf4a77a617f2102a5ccfae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4df15f6a6dd45dab12d0b724076a23e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:12:29.854655 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-e6fe824d-bbbe-4c4a-8c41-a14e82909498 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] 10.222.0.43 "GET /compute/v2.1/servers/a801a87e-5f0e-4158-8961-e30899677422" status: 200 len: 1367 microversion: 2.1 time: 0.156260 Jun 29 08:12:29.855222 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 468/944] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:12:29 2022] GET /compute/v2.1/servers/a801a87e-5f0e-4158-8961-e30899677422 => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:12:30.879423 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-9f02d2ec-18f6-4904-8e1b-a074c3281504 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:12:30.880027 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-9f02d2ec-18f6-4904-8e1b-a074c3281504 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] [instance: a801a87e-5f0e-4158-8961-e30899677422] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:12:30.886837 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-9f02d2ec-18f6-4904-8e1b-a074c3281504 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:12:30.887317 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-9f02d2ec-18f6-4904-8e1b-a074c3281504 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:12:30.888100 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-9f02d2ec-18f6-4904-8e1b-a074c3281504 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:12:30.888542 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-9f02d2ec-18f6-4904-8e1b-a074c3281504 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:12:31.053167 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-9f02d2ec-18f6-4904-8e1b-a074c3281504 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4873db0f2fbf4a77a617f2102a5ccfae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4df15f6a6dd45dab12d0b724076a23e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:12:31.060960 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-9f02d2ec-18f6-4904-8e1b-a074c3281504 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] 10.222.0.43 "GET /compute/v2.1/servers/a801a87e-5f0e-4158-8961-e30899677422" status: 200 len: 1367 microversion: 2.1 time: 0.186190 Jun 29 08:12:31.061585 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 477/945] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:12:30 2022] GET /compute/v2.1/servers/a801a87e-5f0e-4158-8961-e30899677422 => generated 1367 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:12:31.347407 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [req-288f30f7-1813-4fdb-905d-ce8bd9c86d3d req-90c09acd-936e-4c0f-92c4-4f200ac79e33 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a801a87e-5f0e-4158-8961-e30899677422", "name": "network-vif-plugged", "status": "completed", "tag": "98a6c7dc-e52d-4148-91a3-dd6e54263a43"}]} {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:12:31.356947 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [req-288f30f7-1813-4fdb-905d-ce8bd9c86d3d req-90c09acd-936e-4c0f-92c4-4f200ac79e33 service nova] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:12:31.357428 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [req-288f30f7-1813-4fdb-905d-ce8bd9c86d3d req-90c09acd-936e-4c0f-92c4-4f200ac79e33 service nova] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:12:31.372508 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.compute.server_external_events [req-288f30f7-1813-4fdb-905d-ce8bd9c86d3d req-90c09acd-936e-4c0f-92c4-4f200ac79e33 service nova] Creating event network-vif-plugged:98a6c7dc-e52d-4148-91a3-dd6e54263a43 for instance a801a87e-5f0e-4158-8961-e30899677422 on hv-cinder-76810 Jun 29 08:12:31.378394 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [req-288f30f7-1813-4fdb-905d-ce8bd9c86d3d req-90c09acd-936e-4c0f-92c4-4f200ac79e33 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034911 Jun 29 08:12:31.379366 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 469/946] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jun 29 08:12:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:12:32.077052 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-a183454e-8df5-4cde-907c-7bce61b2563c tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:12:32.077673 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-a183454e-8df5-4cde-907c-7bce61b2563c tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] [instance: a801a87e-5f0e-4158-8961-e30899677422] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:12:32.085650 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-a183454e-8df5-4cde-907c-7bce61b2563c tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:12:32.086107 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-a183454e-8df5-4cde-907c-7bce61b2563c tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:12:32.086889 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-a183454e-8df5-4cde-907c-7bce61b2563c tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:12:32.087331 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-a183454e-8df5-4cde-907c-7bce61b2563c tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:12:32.228904 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-a183454e-8df5-4cde-907c-7bce61b2563c tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4873db0f2fbf4a77a617f2102a5ccfae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4df15f6a6dd45dab12d0b724076a23e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:12:32.237053 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-a183454e-8df5-4cde-907c-7bce61b2563c tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] 10.222.0.43 "GET /compute/v2.1/servers/a801a87e-5f0e-4158-8961-e30899677422" status: 200 len: 1367 microversion: 2.1 time: 0.163829 Jun 29 08:12:32.237632 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 478/947] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:12:32 2022] GET /compute/v2.1/servers/a801a87e-5f0e-4158-8961-e30899677422 => generated 1367 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:12:33.254772 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-c66c1a60-560b-4c36-88a7-a730ed498d05 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:12:33.255470 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-c66c1a60-560b-4c36-88a7-a730ed498d05 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] [instance: a801a87e-5f0e-4158-8961-e30899677422] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:12:33.257909 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG dbcounter [-] [117890] Writing DB stats nova_cell0:SELECT=2 {{(pid=117890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:12:33.258572 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG dbcounter [-] [117890] Writing DB stats nova_cell0:SELECT=6 {{(pid=117890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:12:33.265244 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-c66c1a60-560b-4c36-88a7-a730ed498d05 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:12:33.265691 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-c66c1a60-560b-4c36-88a7-a730ed498d05 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:12:33.266506 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-c66c1a60-560b-4c36-88a7-a730ed498d05 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:12:33.267699 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-c66c1a60-560b-4c36-88a7-a730ed498d05 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:12:33.399672 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-c66c1a60-560b-4c36-88a7-a730ed498d05 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4873db0f2fbf4a77a617f2102a5ccfae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4df15f6a6dd45dab12d0b724076a23e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:12:33.407593 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-c66c1a60-560b-4c36-88a7-a730ed498d05 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] 10.222.0.43 "GET /compute/v2.1/servers/a801a87e-5f0e-4158-8961-e30899677422" status: 200 len: 1557 microversion: 2.1 time: 0.156895 Jun 29 08:12:33.408148 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 470/948] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:12:33 2022] GET /compute/v2.1/servers/a801a87e-5f0e-4158-8961-e30899677422 => generated 1557 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:12:33.426130 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-a9cb4eeb-2345-4e00-97ab-1a522486768d tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:12:33.426709 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-a9cb4eeb-2345-4e00-97ab-1a522486768d tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] [instance: a801a87e-5f0e-4158-8961-e30899677422] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:12:33.428612 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_cell0:SELECT=6 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:12:33.434460 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-a9cb4eeb-2345-4e00-97ab-1a522486768d tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:12:33.434914 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-a9cb4eeb-2345-4e00-97ab-1a522486768d tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:12:33.435682 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-a9cb4eeb-2345-4e00-97ab-1a522486768d tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:12:33.436121 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-a9cb4eeb-2345-4e00-97ab-1a522486768d tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:12:33.518375 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-a9cb4eeb-2345-4e00-97ab-1a522486768d tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] 10.222.0.43 "GET /compute/v2.1/servers/a801a87e-5f0e-4158-8961-e30899677422/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.097420 Jun 29 08:12:33.518916 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 479/949] 10.222.0.43 () {58 vars in 1274 bytes} [Wed Jun 29 08:12:33 2022] GET /compute/v2.1/servers/a801a87e-5f0e-4158-8961-e30899677422/os-interface => generated 285 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 29 08:12:34.727401 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [req-3cb7da3d-67f2-4842-80c2-aec81ae1be18 req-c9a08e0e-d47f-4f3c-8556-5af2b4a43a99 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a801a87e-5f0e-4158-8961-e30899677422", "tag": "98a6c7dc-e52d-4148-91a3-dd6e54263a43"}]} {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:12:34.737484 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [req-3cb7da3d-67f2-4842-80c2-aec81ae1be18 req-c9a08e0e-d47f-4f3c-8556-5af2b4a43a99 service nova] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:12:34.737935 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [req-3cb7da3d-67f2-4842-80c2-aec81ae1be18 req-c9a08e0e-d47f-4f3c-8556-5af2b4a43a99 service nova] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:12:34.750440 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.compute.server_external_events [req-3cb7da3d-67f2-4842-80c2-aec81ae1be18 req-c9a08e0e-d47f-4f3c-8556-5af2b4a43a99 service nova] Creating event network-changed:98a6c7dc-e52d-4148-91a3-dd6e54263a43 for instance a801a87e-5f0e-4158-8961-e30899677422 on hv-cinder-76810 Jun 29 08:12:34.756217 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [req-3cb7da3d-67f2-4842-80c2-aec81ae1be18 req-c9a08e0e-d47f-4f3c-8556-5af2b4a43a99 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032649 Jun 29 08:12:34.756838 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 471/950] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jun 29 08:12:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:13:05.097858 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=1 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:13:05.098666 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_cell1:SELECT=74,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:13:05.102581 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-c33d20b7-1d82-484e-b4e1-213c76528d87 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:13:05.103069 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-c33d20b7-1d82-484e-b4e1-213c76528d87 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] [instance: a801a87e-5f0e-4158-8961-e30899677422] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:13:05.110874 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c33d20b7-1d82-484e-b4e1-213c76528d87 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:13:05.111326 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c33d20b7-1d82-484e-b4e1-213c76528d87 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:13:05.112094 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c33d20b7-1d82-484e-b4e1-213c76528d87 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:13:05.112533 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c33d20b7-1d82-484e-b4e1-213c76528d87 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:13:05.138545 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-c33d20b7-1d82-484e-b4e1-213c76528d87 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] 10.222.0.43 "GET /compute/v2.1/servers/a801a87e-5f0e-4158-8961-e30899677422/ips" status: 200 len: 150 microversion: 2.1 time: 0.042097 Jun 29 08:13:05.139570 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 29 08:13:05.139729 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 480/951] 10.222.0.43 () {58 vars in 1247 bytes} [Wed Jun 29 08:13:05 2022] GET /compute/v2.1/servers/a801a87e-5f0e-4158-8961-e30899677422/ips => generated 150 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:13:05.140029 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: Wed Jun 29 08:13:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 29 08:13:06.468376 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG dbcounter [-] [117890] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=117890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:13:06.469170 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG dbcounter [-] [117890] Writing DB stats nova_cell1:SELECT=70,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:13:06.474145 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-f5cdc60a-ee47-400f-bad3-a23871bc3a14 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f4dfef22-a715-491b-bb98-5a9a7c1aa2e1"}} {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:13:06.475302 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-f5cdc60a-ee47-400f-bad3-a23871bc3a14 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] [instance: a801a87e-5f0e-4158-8961-e30899677422] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:13:06.483769 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-f5cdc60a-ee47-400f-bad3-a23871bc3a14 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:13:06.484372 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-f5cdc60a-ee47-400f-bad3-a23871bc3a14 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:13:06.485200 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-f5cdc60a-ee47-400f-bad3-a23871bc3a14 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:13:06.485645 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-f5cdc60a-ee47-400f-bad3-a23871bc3a14 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:13:06.925266 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-f5cdc60a-ee47-400f-bad3-a23871bc3a14 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] 10.222.0.43 "POST /compute/v2.1/servers/a801a87e-5f0e-4158-8961-e30899677422/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.458126 Jun 29 08:13:06.925788 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 472/952] 10.222.0.43 () {60 vars in 1322 bytes} [Wed Jun 29 08:13:06 2022] POST /compute/v2.1/servers/a801a87e-5f0e-4158-8961-e30899677422/os-volume_attachments => generated 194 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:13:14.532788 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-ae0d0439-a53f-4108-92ce-68f569eb05c1 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:13:14.533438 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-ae0d0439-a53f-4108-92ce-68f569eb05c1 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] [instance: a801a87e-5f0e-4158-8961-e30899677422] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:13:14.540041 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ae0d0439-a53f-4108-92ce-68f569eb05c1 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:13:14.540483 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ae0d0439-a53f-4108-92ce-68f569eb05c1 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:13:14.541302 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ae0d0439-a53f-4108-92ce-68f569eb05c1 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:13:14.541742 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ae0d0439-a53f-4108-92ce-68f569eb05c1 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:13:14.690006 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.objects.instance [None req-ae0d0439-a53f-4108-92ce-68f569eb05c1 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lazy-loading 'services' on Instance uuid a801a87e-5f0e-4158-8961-e30899677422 {{(pid=117889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 29 08:13:14.787168 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-ae0d0439-a53f-4108-92ce-68f569eb05c1 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] 10.222.0.43 "DELETE /compute/v2.1/servers/a801a87e-5f0e-4158-8961-e30899677422/os-volume_attachments/f4dfef22-a715-491b-bb98-5a9a7c1aa2e1" status: 202 len: 0 microversion: 2.1 time: 0.257361 Jun 29 08:13:14.788325 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 481/953] 10.222.0.43 () {58 vars in 1415 bytes} [Wed Jun 29 08:13:14 2022] DELETE /compute/v2.1/servers/a801a87e-5f0e-4158-8961-e30899677422/os-volume_attachments/f4dfef22-a715-491b-bb98-5a9a7c1aa2e1 => generated 0 bytes in 260 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 29 08:13:14.798078 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-58a3c3e3-95b3-4e35-b132-fb20beefa1c9 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:13:14.799152 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-58a3c3e3-95b3-4e35-b132-fb20beefa1c9 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] [instance: a801a87e-5f0e-4158-8961-e30899677422] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:13:14.807780 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-58a3c3e3-95b3-4e35-b132-fb20beefa1c9 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:13:14.808233 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-58a3c3e3-95b3-4e35-b132-fb20beefa1c9 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:13:14.809082 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-58a3c3e3-95b3-4e35-b132-fb20beefa1c9 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:13:14.809525 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-58a3c3e3-95b3-4e35-b132-fb20beefa1c9 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:13:14.841352 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-58a3c3e3-95b3-4e35-b132-fb20beefa1c9 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] 10.222.0.43 "GET /compute/v2.1/servers/a801a87e-5f0e-4158-8961-e30899677422/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047539 Jun 29 08:13:14.841838 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 473/954] 10.222.0.43 () {58 vars in 1301 bytes} [Wed Jun 29 08:13:14 2022] GET /compute/v2.1/servers/a801a87e-5f0e-4158-8961-e30899677422/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:13:15.855250 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-1d6f11a2-fc6b-4db5-b4f2-7e935ee0fec5 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:13:15.856319 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-1d6f11a2-fc6b-4db5-b4f2-7e935ee0fec5 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] [instance: a801a87e-5f0e-4158-8961-e30899677422] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:13:15.862721 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-1d6f11a2-fc6b-4db5-b4f2-7e935ee0fec5 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:13:15.863179 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-1d6f11a2-fc6b-4db5-b4f2-7e935ee0fec5 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:13:15.863951 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-1d6f11a2-fc6b-4db5-b4f2-7e935ee0fec5 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:13:15.864390 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-1d6f11a2-fc6b-4db5-b4f2-7e935ee0fec5 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:13:15.893956 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-1d6f11a2-fc6b-4db5-b4f2-7e935ee0fec5 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] 10.222.0.43 "GET /compute/v2.1/servers/a801a87e-5f0e-4158-8961-e30899677422/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043766 Jun 29 08:13:15.894517 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 482/955] 10.222.0.43 () {58 vars in 1301 bytes} [Wed Jun 29 08:13:15 2022] GET /compute/v2.1/servers/a801a87e-5f0e-4158-8961-e30899677422/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 29 08:13:15.953282 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-0b249b4a-02ae-4d3b-85d4-a6f3674139f5 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:13:15.953808 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-0b249b4a-02ae-4d3b-85d4-a6f3674139f5 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] [instance: a801a87e-5f0e-4158-8961-e30899677422] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:13:15.960226 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-0b249b4a-02ae-4d3b-85d4-a6f3674139f5 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:13:15.960754 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-0b249b4a-02ae-4d3b-85d4-a6f3674139f5 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:13:15.961553 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-0b249b4a-02ae-4d3b-85d4-a6f3674139f5 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:13:15.961999 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-0b249b4a-02ae-4d3b-85d4-a6f3674139f5 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:13:15.988321 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-0b249b4a-02ae-4d3b-85d4-a6f3674139f5 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] [instance: a801a87e-5f0e-4158-8961-e30899677422] Going to try to terminate instance {{(pid=117890) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 29 08:13:16.068358 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-0b249b4a-02ae-4d3b-85d4-a6f3674139f5 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] 10.222.0.43 "DELETE /compute/v2.1/servers/a801a87e-5f0e-4158-8961-e30899677422" status: 204 len: 0 microversion: 2.1 time: 0.118735 Jun 29 08:13:16.069013 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 474/956] 10.222.0.43 () {58 vars in 1238 bytes} [Wed Jun 29 08:13:15 2022] DELETE /compute/v2.1/servers/a801a87e-5f0e-4158-8961-e30899677422 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 29 08:13:16.077988 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-ba2db039-62b5-493e-8d03-fd2a5ad9cd9f tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:13:16.078604 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-ba2db039-62b5-493e-8d03-fd2a5ad9cd9f tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] [instance: a801a87e-5f0e-4158-8961-e30899677422] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:13:16.084619 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ba2db039-62b5-493e-8d03-fd2a5ad9cd9f tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:13:16.085110 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ba2db039-62b5-493e-8d03-fd2a5ad9cd9f tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:13:16.086623 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ba2db039-62b5-493e-8d03-fd2a5ad9cd9f tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:13:16.087069 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ba2db039-62b5-493e-8d03-fd2a5ad9cd9f tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:13:16.235893 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-ba2db039-62b5-493e-8d03-fd2a5ad9cd9f tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4873db0f2fbf4a77a617f2102a5ccfae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4df15f6a6dd45dab12d0b724076a23e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:13:16.243990 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-ba2db039-62b5-493e-8d03-fd2a5ad9cd9f tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] 10.222.0.43 "GET /compute/v2.1/servers/a801a87e-5f0e-4158-8961-e30899677422" status: 200 len: 1682 microversion: 2.1 time: 0.170197 Jun 29 08:13:16.244550 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 483/957] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:13:16 2022] GET /compute/v2.1/servers/a801a87e-5f0e-4158-8961-e30899677422 => generated 1682 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:13:17.262213 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-2dbd5250-dfbb-4634-9891-6e1000b6e3fc tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:13:17.262951 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-2dbd5250-dfbb-4634-9891-6e1000b6e3fc tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] [instance: a801a87e-5f0e-4158-8961-e30899677422] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:13:17.269653 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-2dbd5250-dfbb-4634-9891-6e1000b6e3fc tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:13:17.270120 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-2dbd5250-dfbb-4634-9891-6e1000b6e3fc tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:13:17.270877 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-2dbd5250-dfbb-4634-9891-6e1000b6e3fc tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:13:17.271307 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-2dbd5250-dfbb-4634-9891-6e1000b6e3fc tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:13:17.410551 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-2dbd5250-dfbb-4634-9891-6e1000b6e3fc tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4873db0f2fbf4a77a617f2102a5ccfae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4df15f6a6dd45dab12d0b724076a23e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:13:17.418464 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-2dbd5250-dfbb-4634-9891-6e1000b6e3fc tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] 10.222.0.43 "GET /compute/v2.1/servers/a801a87e-5f0e-4158-8961-e30899677422" status: 200 len: 1682 microversion: 2.1 time: 0.161181 Jun 29 08:13:17.419044 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 475/958] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:13:17 2022] GET /compute/v2.1/servers/a801a87e-5f0e-4158-8961-e30899677422 => generated 1682 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:13:18.435660 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-4c427e45-5949-44c3-b704-9d4d0e39ba0e tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:13:18.436449 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-4c427e45-5949-44c3-b704-9d4d0e39ba0e tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] [instance: a801a87e-5f0e-4158-8961-e30899677422] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:13:18.443007 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-4c427e45-5949-44c3-b704-9d4d0e39ba0e tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:13:18.443461 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-4c427e45-5949-44c3-b704-9d4d0e39ba0e tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:13:18.444240 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-4c427e45-5949-44c3-b704-9d4d0e39ba0e tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:13:18.445251 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-4c427e45-5949-44c3-b704-9d4d0e39ba0e tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:13:18.516388 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-4c427e45-5949-44c3-b704-9d4d0e39ba0e tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4873db0f2fbf4a77a617f2102a5ccfae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4df15f6a6dd45dab12d0b724076a23e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:13:18.525467 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-4c427e45-5949-44c3-b704-9d4d0e39ba0e tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] 10.222.0.43 "GET /compute/v2.1/servers/a801a87e-5f0e-4158-8961-e30899677422" status: 200 len: 1614 microversion: 2.1 time: 0.093588 Jun 29 08:13:18.526119 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 484/959] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:13:18 2022] GET /compute/v2.1/servers/a801a87e-5f0e-4158-8961-e30899677422 => generated 1614 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:13:18.537721 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [req-dfc269fa-475e-4cea-9b27-841600741eb5 req-c333f377-0d70-41d2-9294-bdb6ac50d11e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a801a87e-5f0e-4158-8961-e30899677422", "name": "network-vif-deleted", "tag": "98a6c7dc-e52d-4148-91a3-dd6e54263a43"}]} {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:13:18.547580 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [req-dfc269fa-475e-4cea-9b27-841600741eb5 req-c333f377-0d70-41d2-9294-bdb6ac50d11e service nova] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:13:18.548204 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [req-dfc269fa-475e-4cea-9b27-841600741eb5 req-c333f377-0d70-41d2-9294-bdb6ac50d11e service nova] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:13:18.580325 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.compute.server_external_events [req-dfc269fa-475e-4cea-9b27-841600741eb5 req-c333f377-0d70-41d2-9294-bdb6ac50d11e service nova] Creating event network-vif-deleted:98a6c7dc-e52d-4148-91a3-dd6e54263a43 for instance a801a87e-5f0e-4158-8961-e30899677422 on hv-cinder-76810 Jun 29 08:13:18.587807 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [req-dfc269fa-475e-4cea-9b27-841600741eb5 req-c333f377-0d70-41d2-9294-bdb6ac50d11e service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053714 Jun 29 08:13:18.588909 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 476/960] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jun 29 08:13:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:13:19.545460 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-0b20149c-8bec-42dd-aac8-fdca071542b4 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:13:19.546222 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-0b20149c-8bec-42dd-aac8-fdca071542b4 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] [instance: a801a87e-5f0e-4158-8961-e30899677422] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:13:19.553429 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-0b20149c-8bec-42dd-aac8-fdca071542b4 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:13:19.553876 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-0b20149c-8bec-42dd-aac8-fdca071542b4 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:13:19.555332 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-0b20149c-8bec-42dd-aac8-fdca071542b4 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:13:19.555933 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-0b20149c-8bec-42dd-aac8-fdca071542b4 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:13:19.570908 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.wsgi [None req-0b20149c-8bec-42dd-aac8-fdca071542b4 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] HTTP exception thrown: Instance a801a87e-5f0e-4158-8961-e30899677422 could not be found. Jun 29 08:13:19.572595 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-0b20149c-8bec-42dd-aac8-fdca071542b4 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Request method failure captured: Jun 29 08:13:19.572595 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: request: GET /compute/v2.1/servers/a801a87e-5f0e-4158-8961-e30899677422 HTTP/1.1 Jun 29 08:13:19.572595 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: Accept: application/json Jun 29 08:13:19.572595 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: Accept-Encoding: identity Jun 29 08:13:19.572595 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: Connection: close Jun 29 08:13:19.572595 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: Content-Length: 0 Jun 29 08:13:19.572595 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: Content-Type: application/json Jun 29 08:13:19.572595 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: Host: 10.222.0.43 Jun 29 08:13:19.572595 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: Openstack-System-Scope: None Jun 29 08:13:19.572595 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: User-Agent: python-urllib3/1.26.9 Jun 29 08:13:19.572595 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Auth-Token: gAAAAABivAiYnWOqjiwHcE1PCPUmCrIvEMkbVX7lWZxh9jPOZ_GtAOja07fGzXFEXqZ7Ky0xacgV6SGsTaq5tzX8bh-ZG0acOi-203kWLHdiaJ2wslMtHKMClYhsYgyOgs9fcpZ5v5SN8dlG-3pGiAd5z4Hj9kmL7TX1CMp1QfZwI7CaxfijbC4 Jun 29 08:13:19.572595 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Domain-Id: None Jun 29 08:13:19.572595 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Domain-Name: None Jun 29 08:13:19.572595 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Identity-Status: Confirmed Jun 29 08:13:19.572595 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Is-Admin-Project: True Jun 29 08:13:19.572595 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Project-Domain-Id: default Jun 29 08:13:19.572595 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Project-Domain-Name: Default Jun 29 08:13:19.572595 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Project-Id: a4df15f6a6dd45dab12d0b724076a23e Jun 29 08:13:19.572595 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Project-Name: tempest-AttachVolumeNegativeTest-471433960 Jun 29 08:13:19.572595 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Role: member,reader Jun 29 08:13:19.572595 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Roles: member,reader Jun 29 08:13:19.574501 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a4df15f6a6dd45dab12d0b724076a23e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_a4df15f6a6dd45dab12d0b724076a23e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a4df15f6a6dd45dab12d0b724076a23e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/a4df15f6a6dd45dab12d0b724076a23e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Jun 29 08:13:19.574501 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Tenant: tempest-AttachVolumeNegativeTest-471433960 Jun 29 08:13:19.574501 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Tenant-Id: a4df15f6a6dd45dab12d0b724076a23e Jun 29 08:13:19.574501 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-471433960 Jun 29 08:13:19.574501 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-User: tempest-AttachVolumeNegativeTest-471433960-project Jun 29 08:13:19.574501 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-User-Domain-Id: default Jun 29 08:13:19.574501 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-User-Domain-Name: Default Jun 29 08:13:19.574501 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-User-Id: 4873db0f2fbf4a77a617f2102a5ccfae Jun 29 08:13:19.574501 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-User-Name: tempest-AttachVolumeNegativeTest-471433960-project Jun 29 08:13:19.574501 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: method: > Jun 29 08:13:19.574501 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: exception: Instance a801a87e-5f0e-4158-8961-e30899677422 could not be found. Jun 29 08:13:19.574501 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: action_args: {'id': 'a801a87e-5f0e-4158-8961-e30899677422'} Jun 29 08:13:19.578886 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 08:13:19.578886 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:13:19.578886 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 29 08:13:19.578886 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 29 08:13:19.578886 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 29 08:13:19.578886 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 29 08:13:19.578886 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 29 08:13:19.578886 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 29 08:13:19.578886 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 29 08:13:19.578886 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 29 08:13:19.578886 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a801a87e-5f0e-4158-8961-e30899677422 could not be found. Jun 29 08:13:19.578886 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 29 08:13:19.578886 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 08:13:19.578886 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 29 08:13:19.578886 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:13:19.578886 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 08:13:19.578886 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 08:13:19.578886 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 08:13:19.578886 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 08:13:19.578886 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 08:13:19.580546 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 08:13:19.580546 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 29 08:13:19.580546 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 29 08:13:19.580546 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 29 08:13:19.580546 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 29 08:13:19.580546 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 29 08:13:19.580546 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 29 08:13:19.580546 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a801a87e-5f0e-4158-8961-e30899677422 could not be found. Jun 29 08:13:19.580546 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 29 08:13:19.580546 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 08:13:19.580546 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 29 08:13:19.580546 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:13:19.580546 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 08:13:19.580546 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 08:13:19.580546 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 08:13:19.580546 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 08:13:19.580546 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a801a87e-5f0e-4158-8961-e30899677422 could not be found. Jun 29 08:13:19.580546 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 29 08:13:19.581967 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-0b20149c-8bec-42dd-aac8-fdca071542b4 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Returning 404 to user: Instance a801a87e-5f0e-4158-8961-e30899677422 could not be found. {{(pid=117889) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 08:13:19.581967 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-0b20149c-8bec-42dd-aac8-fdca071542b4 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] 10.222.0.43 "GET /compute/v2.1/servers/a801a87e-5f0e-4158-8961-e30899677422" status: 404 len: 111 microversion: 2.1 time: 0.034636 Jun 29 08:13:19.581967 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 485/961] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:13:19 2022] GET /compute/v2.1/servers/a801a87e-5f0e-4158-8961-e30899677422 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 29 08:13:19.583653 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-478d39ac-7de8-49cc-b5ab-e4a704813d93 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Calling method '.version_select at 0x7f7241340e50>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:13:19.605610 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-478d39ac-7de8-49cc-b5ab-e4a704813d93 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-594512687" status: 202 len: 0 microversion: 2.1 time: 0.025218 Jun 29 08:13:19.605871 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 477/962] 10.222.0.43 () {58 vars in 1217 bytes} [Wed Jun 29 08:13:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-594512687 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 29 08:13:21.422410 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-ca2446a6-3fc0-4bcd-9243-ae51a352921d tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:13:21.423001 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-ca2446a6-3fc0-4bcd-9243-ae51a352921d tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] [instance: a801a87e-5f0e-4158-8961-e30899677422] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:13:21.431299 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ca2446a6-3fc0-4bcd-9243-ae51a352921d tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:13:21.431744 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ca2446a6-3fc0-4bcd-9243-ae51a352921d tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:13:21.432526 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ca2446a6-3fc0-4bcd-9243-ae51a352921d tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:13:21.432968 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ca2446a6-3fc0-4bcd-9243-ae51a352921d tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:13:21.447547 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.wsgi [None req-ca2446a6-3fc0-4bcd-9243-ae51a352921d tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] HTTP exception thrown: Instance a801a87e-5f0e-4158-8961-e30899677422 could not be found. Jun 29 08:13:21.449200 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-ca2446a6-3fc0-4bcd-9243-ae51a352921d tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Request method failure captured: Jun 29 08:13:21.449200 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: request: DELETE /compute/v2.1/servers/a801a87e-5f0e-4158-8961-e30899677422 HTTP/1.1 Jun 29 08:13:21.449200 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: Accept: application/json Jun 29 08:13:21.449200 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: Accept-Encoding: identity Jun 29 08:13:21.449200 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: Connection: close Jun 29 08:13:21.449200 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: Content-Length: 0 Jun 29 08:13:21.449200 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: Content-Type: application/json Jun 29 08:13:21.449200 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: Host: 10.222.0.43 Jun 29 08:13:21.449200 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: Openstack-System-Scope: None Jun 29 08:13:21.449200 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: User-Agent: python-urllib3/1.26.9 Jun 29 08:13:21.449200 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Auth-Token: gAAAAABivAiYnWOqjiwHcE1PCPUmCrIvEMkbVX7lWZxh9jPOZ_GtAOja07fGzXFEXqZ7Ky0xacgV6SGsTaq5tzX8bh-ZG0acOi-203kWLHdiaJ2wslMtHKMClYhsYgyOgs9fcpZ5v5SN8dlG-3pGiAd5z4Hj9kmL7TX1CMp1QfZwI7CaxfijbC4 Jun 29 08:13:21.449200 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Domain-Id: None Jun 29 08:13:21.449200 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Domain-Name: None Jun 29 08:13:21.449200 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Identity-Status: Confirmed Jun 29 08:13:21.449200 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Is-Admin-Project: True Jun 29 08:13:21.449200 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Project-Domain-Id: default Jun 29 08:13:21.449200 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Project-Domain-Name: Default Jun 29 08:13:21.449200 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Project-Id: a4df15f6a6dd45dab12d0b724076a23e Jun 29 08:13:21.449200 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Project-Name: tempest-AttachVolumeNegativeTest-471433960 Jun 29 08:13:21.449200 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Role: member,reader Jun 29 08:13:21.449200 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Roles: member,reader Jun 29 08:13:21.450863 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a4df15f6a6dd45dab12d0b724076a23e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_a4df15f6a6dd45dab12d0b724076a23e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a4df15f6a6dd45dab12d0b724076a23e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/a4df15f6a6dd45dab12d0b724076a23e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Jun 29 08:13:21.450863 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Tenant: tempest-AttachVolumeNegativeTest-471433960 Jun 29 08:13:21.450863 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Tenant-Id: a4df15f6a6dd45dab12d0b724076a23e Jun 29 08:13:21.450863 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-471433960 Jun 29 08:13:21.450863 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-User: tempest-AttachVolumeNegativeTest-471433960-project Jun 29 08:13:21.450863 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-User-Domain-Id: default Jun 29 08:13:21.450863 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-User-Domain-Name: Default Jun 29 08:13:21.450863 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-User-Id: 4873db0f2fbf4a77a617f2102a5ccfae Jun 29 08:13:21.450863 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-User-Name: tempest-AttachVolumeNegativeTest-471433960-project Jun 29 08:13:21.450863 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: method: > Jun 29 08:13:21.450863 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: exception: Instance a801a87e-5f0e-4158-8961-e30899677422 could not be found. Jun 29 08:13:21.450863 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: action_args: {'id': 'a801a87e-5f0e-4158-8961-e30899677422'} Jun 29 08:13:21.451864 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 08:13:21.451864 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:13:21.451864 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 29 08:13:21.451864 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 29 08:13:21.451864 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 29 08:13:21.451864 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 29 08:13:21.451864 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 29 08:13:21.451864 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 29 08:13:21.451864 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 29 08:13:21.451864 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 29 08:13:21.451864 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a801a87e-5f0e-4158-8961-e30899677422 could not be found. Jun 29 08:13:21.451864 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 29 08:13:21.451864 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 08:13:21.451864 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 29 08:13:21.451864 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:13:21.451864 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 08:13:21.451864 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 08:13:21.451864 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 08:13:21.451864 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 08:13:21.451864 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 08:13:21.453384 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 08:13:21.453384 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 29 08:13:21.453384 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 29 08:13:21.453384 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 29 08:13:21.453384 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 29 08:13:21.453384 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 29 08:13:21.453384 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 29 08:13:21.453384 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 29 08:13:21.453384 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 29 08:13:21.453384 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a801a87e-5f0e-4158-8961-e30899677422 could not be found. Jun 29 08:13:21.453384 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 29 08:13:21.453384 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 08:13:21.453384 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 29 08:13:21.453384 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:13:21.453384 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 08:13:21.453384 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 08:13:21.453384 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 08:13:21.453384 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 08:13:21.453384 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a801a87e-5f0e-4158-8961-e30899677422 could not be found. Jun 29 08:13:21.453384 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 29 08:13:21.454938 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-ca2446a6-3fc0-4bcd-9243-ae51a352921d tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Returning 404 to user: Instance a801a87e-5f0e-4158-8961-e30899677422 could not be found. {{(pid=117889) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 08:13:21.454938 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-ca2446a6-3fc0-4bcd-9243-ae51a352921d tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] 10.222.0.43 "DELETE /compute/v2.1/servers/a801a87e-5f0e-4158-8961-e30899677422" status: 404 len: 111 microversion: 2.1 time: 0.032313 Jun 29 08:13:21.454938 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 486/963] 10.222.0.43 () {58 vars in 1238 bytes} [Wed Jun 29 08:13:21 2022] DELETE /compute/v2.1/servers/a801a87e-5f0e-4158-8961-e30899677422 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 29 08:13:21.459551 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-87788800-4987-45a4-bdb9-1824164a10a5 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:13:21.460303 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-87788800-4987-45a4-bdb9-1824164a10a5 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] [instance: a801a87e-5f0e-4158-8961-e30899677422] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:13:21.468207 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-87788800-4987-45a4-bdb9-1824164a10a5 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:13:21.468651 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-87788800-4987-45a4-bdb9-1824164a10a5 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:13:21.469457 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-87788800-4987-45a4-bdb9-1824164a10a5 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:13:21.469894 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-87788800-4987-45a4-bdb9-1824164a10a5 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:13:21.485096 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.wsgi [None req-87788800-4987-45a4-bdb9-1824164a10a5 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] HTTP exception thrown: Instance a801a87e-5f0e-4158-8961-e30899677422 could not be found. Jun 29 08:13:21.486787 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-87788800-4987-45a4-bdb9-1824164a10a5 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Request method failure captured: Jun 29 08:13:21.486787 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: request: GET /compute/v2.1/servers/a801a87e-5f0e-4158-8961-e30899677422 HTTP/1.1 Jun 29 08:13:21.486787 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: Accept: application/json Jun 29 08:13:21.486787 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: Accept-Encoding: identity Jun 29 08:13:21.486787 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: Connection: close Jun 29 08:13:21.486787 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: Content-Length: 0 Jun 29 08:13:21.486787 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: Content-Type: application/json Jun 29 08:13:21.486787 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: Host: 10.222.0.43 Jun 29 08:13:21.486787 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: Openstack-System-Scope: None Jun 29 08:13:21.486787 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: User-Agent: python-urllib3/1.26.9 Jun 29 08:13:21.486787 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Auth-Token: gAAAAABivAiYnWOqjiwHcE1PCPUmCrIvEMkbVX7lWZxh9jPOZ_GtAOja07fGzXFEXqZ7Ky0xacgV6SGsTaq5tzX8bh-ZG0acOi-203kWLHdiaJ2wslMtHKMClYhsYgyOgs9fcpZ5v5SN8dlG-3pGiAd5z4Hj9kmL7TX1CMp1QfZwI7CaxfijbC4 Jun 29 08:13:21.486787 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Domain-Id: None Jun 29 08:13:21.486787 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Domain-Name: None Jun 29 08:13:21.486787 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Identity-Status: Confirmed Jun 29 08:13:21.486787 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Is-Admin-Project: True Jun 29 08:13:21.486787 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Project-Domain-Id: default Jun 29 08:13:21.486787 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Project-Domain-Name: Default Jun 29 08:13:21.486787 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Project-Id: a4df15f6a6dd45dab12d0b724076a23e Jun 29 08:13:21.486787 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Project-Name: tempest-AttachVolumeNegativeTest-471433960 Jun 29 08:13:21.486787 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Role: member,reader Jun 29 08:13:21.486787 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Roles: member,reader Jun 29 08:13:21.489544 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a4df15f6a6dd45dab12d0b724076a23e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_a4df15f6a6dd45dab12d0b724076a23e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a4df15f6a6dd45dab12d0b724076a23e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/a4df15f6a6dd45dab12d0b724076a23e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Jun 29 08:13:21.489544 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Tenant: tempest-AttachVolumeNegativeTest-471433960 Jun 29 08:13:21.489544 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Tenant-Id: a4df15f6a6dd45dab12d0b724076a23e Jun 29 08:13:21.489544 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-471433960 Jun 29 08:13:21.489544 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-User: tempest-AttachVolumeNegativeTest-471433960-project Jun 29 08:13:21.489544 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-User-Domain-Id: default Jun 29 08:13:21.489544 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-User-Domain-Name: Default Jun 29 08:13:21.489544 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-User-Id: 4873db0f2fbf4a77a617f2102a5ccfae Jun 29 08:13:21.489544 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-User-Name: tempest-AttachVolumeNegativeTest-471433960-project Jun 29 08:13:21.489544 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: method: > Jun 29 08:13:21.489544 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: exception: Instance a801a87e-5f0e-4158-8961-e30899677422 could not be found. Jun 29 08:13:21.489544 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: action_args: {'id': 'a801a87e-5f0e-4158-8961-e30899677422'} Jun 29 08:13:21.490913 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 08:13:21.490913 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:13:21.490913 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 29 08:13:21.490913 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 29 08:13:21.490913 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 29 08:13:21.490913 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 29 08:13:21.490913 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 29 08:13:21.490913 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 29 08:13:21.490913 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 29 08:13:21.490913 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 29 08:13:21.490913 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a801a87e-5f0e-4158-8961-e30899677422 could not be found. Jun 29 08:13:21.490913 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 29 08:13:21.490913 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 08:13:21.490913 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 29 08:13:21.490913 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:13:21.490913 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 08:13:21.490913 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 08:13:21.490913 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 08:13:21.490913 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 08:13:21.490913 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 08:13:21.493204 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 08:13:21.493204 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 29 08:13:21.493204 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 29 08:13:21.493204 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 29 08:13:21.493204 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 29 08:13:21.493204 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 29 08:13:21.493204 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 29 08:13:21.493204 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a801a87e-5f0e-4158-8961-e30899677422 could not be found. Jun 29 08:13:21.493204 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 29 08:13:21.493204 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 08:13:21.493204 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 29 08:13:21.493204 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:13:21.493204 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 08:13:21.493204 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 08:13:21.493204 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 08:13:21.493204 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 08:13:21.493204 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a801a87e-5f0e-4158-8961-e30899677422 could not be found. Jun 29 08:13:21.493204 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 29 08:13:21.494550 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-87788800-4987-45a4-bdb9-1824164a10a5 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Returning 404 to user: Instance a801a87e-5f0e-4158-8961-e30899677422 could not be found. {{(pid=117890) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 08:13:21.494550 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-87788800-4987-45a4-bdb9-1824164a10a5 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] 10.222.0.43 "GET /compute/v2.1/servers/a801a87e-5f0e-4158-8961-e30899677422" status: 404 len: 111 microversion: 2.1 time: 0.032768 Jun 29 08:13:21.494550 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 478/964] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:13:21 2022] GET /compute/v2.1/servers/a801a87e-5f0e-4158-8961-e30899677422 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 29 08:13:22.644367 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-94c16075-9df0-4817-9d31-4ff0270b27ed tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:13:22.644951 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-94c16075-9df0-4817-9d31-4ff0270b27ed tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] [instance: 01330f68-42df-4986-b996-e6403d1555c6] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:13:22.651553 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-94c16075-9df0-4817-9d31-4ff0270b27ed tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:13:22.652007 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-94c16075-9df0-4817-9d31-4ff0270b27ed tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:13:22.652791 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-94c16075-9df0-4817-9d31-4ff0270b27ed tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:13:22.653288 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-94c16075-9df0-4817-9d31-4ff0270b27ed tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:13:22.667276 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.wsgi [None req-94c16075-9df0-4817-9d31-4ff0270b27ed tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] HTTP exception thrown: Instance 01330f68-42df-4986-b996-e6403d1555c6 could not be found. Jun 29 08:13:22.668874 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-94c16075-9df0-4817-9d31-4ff0270b27ed tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Request method failure captured: Jun 29 08:13:22.668874 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: request: DELETE /compute/v2.1/servers/01330f68-42df-4986-b996-e6403d1555c6 HTTP/1.1 Jun 29 08:13:22.668874 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: Accept: application/json Jun 29 08:13:22.668874 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: Accept-Encoding: identity Jun 29 08:13:22.668874 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: Connection: close Jun 29 08:13:22.668874 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: Content-Length: 0 Jun 29 08:13:22.668874 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: Content-Type: application/json Jun 29 08:13:22.668874 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: Host: 10.222.0.43 Jun 29 08:13:22.668874 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: Openstack-System-Scope: None Jun 29 08:13:22.668874 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: User-Agent: python-urllib3/1.26.9 Jun 29 08:13:22.668874 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Auth-Token: gAAAAABivAiYnWOqjiwHcE1PCPUmCrIvEMkbVX7lWZxh9jPOZ_GtAOja07fGzXFEXqZ7Ky0xacgV6SGsTaq5tzX8bh-ZG0acOi-203kWLHdiaJ2wslMtHKMClYhsYgyOgs9fcpZ5v5SN8dlG-3pGiAd5z4Hj9kmL7TX1CMp1QfZwI7CaxfijbC4 Jun 29 08:13:22.668874 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Domain-Id: None Jun 29 08:13:22.668874 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Domain-Name: None Jun 29 08:13:22.668874 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Identity-Status: Confirmed Jun 29 08:13:22.668874 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Is-Admin-Project: True Jun 29 08:13:22.668874 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Project-Domain-Id: default Jun 29 08:13:22.668874 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Project-Domain-Name: Default Jun 29 08:13:22.668874 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Project-Id: a4df15f6a6dd45dab12d0b724076a23e Jun 29 08:13:22.668874 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Project-Name: tempest-AttachVolumeNegativeTest-471433960 Jun 29 08:13:22.668874 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Role: member,reader Jun 29 08:13:22.668874 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Roles: member,reader Jun 29 08:13:22.671509 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a4df15f6a6dd45dab12d0b724076a23e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_a4df15f6a6dd45dab12d0b724076a23e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a4df15f6a6dd45dab12d0b724076a23e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/a4df15f6a6dd45dab12d0b724076a23e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Jun 29 08:13:22.671509 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Tenant: tempest-AttachVolumeNegativeTest-471433960 Jun 29 08:13:22.671509 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Tenant-Id: a4df15f6a6dd45dab12d0b724076a23e Jun 29 08:13:22.671509 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-471433960 Jun 29 08:13:22.671509 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-User: tempest-AttachVolumeNegativeTest-471433960-project Jun 29 08:13:22.671509 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-User-Domain-Id: default Jun 29 08:13:22.671509 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-User-Domain-Name: Default Jun 29 08:13:22.671509 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-User-Id: 4873db0f2fbf4a77a617f2102a5ccfae Jun 29 08:13:22.671509 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-User-Name: tempest-AttachVolumeNegativeTest-471433960-project Jun 29 08:13:22.671509 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: method: > Jun 29 08:13:22.671509 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: exception: Instance 01330f68-42df-4986-b996-e6403d1555c6 could not be found. Jun 29 08:13:22.671509 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: action_args: {'id': '01330f68-42df-4986-b996-e6403d1555c6'} Jun 29 08:13:22.673322 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 08:13:22.673322 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:13:22.673322 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 29 08:13:22.673322 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 29 08:13:22.673322 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 29 08:13:22.673322 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 29 08:13:22.673322 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 29 08:13:22.673322 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 29 08:13:22.673322 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 29 08:13:22.673322 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 29 08:13:22.673322 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 01330f68-42df-4986-b996-e6403d1555c6 could not be found. Jun 29 08:13:22.673322 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 29 08:13:22.673322 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 08:13:22.673322 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 29 08:13:22.673322 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:13:22.673322 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 08:13:22.673322 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 08:13:22.673322 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 08:13:22.673322 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 08:13:22.673322 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 08:13:22.676106 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 08:13:22.676106 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 29 08:13:22.676106 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 29 08:13:22.676106 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 29 08:13:22.676106 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 29 08:13:22.676106 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 29 08:13:22.676106 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 29 08:13:22.676106 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 29 08:13:22.676106 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 29 08:13:22.676106 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 01330f68-42df-4986-b996-e6403d1555c6 could not be found. Jun 29 08:13:22.676106 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 29 08:13:22.676106 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 08:13:22.676106 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 29 08:13:22.676106 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:13:22.676106 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 08:13:22.676106 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 08:13:22.676106 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 08:13:22.676106 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 08:13:22.676106 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 01330f68-42df-4986-b996-e6403d1555c6 could not be found. Jun 29 08:13:22.676106 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 29 08:13:22.679654 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-94c16075-9df0-4817-9d31-4ff0270b27ed tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Returning 404 to user: Instance 01330f68-42df-4986-b996-e6403d1555c6 could not be found. {{(pid=117889) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 08:13:22.679654 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-94c16075-9df0-4817-9d31-4ff0270b27ed tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] 10.222.0.43 "DELETE /compute/v2.1/servers/01330f68-42df-4986-b996-e6403d1555c6" status: 404 len: 111 microversion: 2.1 time: 0.029882 Jun 29 08:13:22.679654 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 487/965] 10.222.0.43 () {58 vars in 1238 bytes} [Wed Jun 29 08:13:22 2022] DELETE /compute/v2.1/servers/01330f68-42df-4986-b996-e6403d1555c6 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 29 08:13:22.682827 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-97dc6d43-7ff1-4359-af22-3c1fd229b883 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:13:22.683442 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-97dc6d43-7ff1-4359-af22-3c1fd229b883 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] [instance: 01330f68-42df-4986-b996-e6403d1555c6] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:13:22.690060 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-97dc6d43-7ff1-4359-af22-3c1fd229b883 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:13:22.690521 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-97dc6d43-7ff1-4359-af22-3c1fd229b883 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:13:22.691295 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-97dc6d43-7ff1-4359-af22-3c1fd229b883 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:13:22.691728 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-97dc6d43-7ff1-4359-af22-3c1fd229b883 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:13:22.706042 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.wsgi [None req-97dc6d43-7ff1-4359-af22-3c1fd229b883 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] HTTP exception thrown: Instance 01330f68-42df-4986-b996-e6403d1555c6 could not be found. Jun 29 08:13:22.707577 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-97dc6d43-7ff1-4359-af22-3c1fd229b883 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Request method failure captured: Jun 29 08:13:22.707577 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: request: GET /compute/v2.1/servers/01330f68-42df-4986-b996-e6403d1555c6 HTTP/1.1 Jun 29 08:13:22.707577 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: Accept: application/json Jun 29 08:13:22.707577 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: Accept-Encoding: identity Jun 29 08:13:22.707577 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: Connection: close Jun 29 08:13:22.707577 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: Content-Length: 0 Jun 29 08:13:22.707577 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: Content-Type: application/json Jun 29 08:13:22.707577 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: Host: 10.222.0.43 Jun 29 08:13:22.707577 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: Openstack-System-Scope: None Jun 29 08:13:22.707577 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: User-Agent: python-urllib3/1.26.9 Jun 29 08:13:22.707577 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Auth-Token: gAAAAABivAiYnWOqjiwHcE1PCPUmCrIvEMkbVX7lWZxh9jPOZ_GtAOja07fGzXFEXqZ7Ky0xacgV6SGsTaq5tzX8bh-ZG0acOi-203kWLHdiaJ2wslMtHKMClYhsYgyOgs9fcpZ5v5SN8dlG-3pGiAd5z4Hj9kmL7TX1CMp1QfZwI7CaxfijbC4 Jun 29 08:13:22.707577 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Domain-Id: None Jun 29 08:13:22.707577 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Domain-Name: None Jun 29 08:13:22.707577 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Identity-Status: Confirmed Jun 29 08:13:22.707577 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Is-Admin-Project: True Jun 29 08:13:22.707577 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Project-Domain-Id: default Jun 29 08:13:22.707577 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Project-Domain-Name: Default Jun 29 08:13:22.707577 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Project-Id: a4df15f6a6dd45dab12d0b724076a23e Jun 29 08:13:22.707577 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Project-Name: tempest-AttachVolumeNegativeTest-471433960 Jun 29 08:13:22.707577 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Role: member,reader Jun 29 08:13:22.707577 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Roles: member,reader Jun 29 08:13:22.709288 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a4df15f6a6dd45dab12d0b724076a23e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_a4df15f6a6dd45dab12d0b724076a23e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a4df15f6a6dd45dab12d0b724076a23e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/a4df15f6a6dd45dab12d0b724076a23e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Jun 29 08:13:22.709288 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Tenant: tempest-AttachVolumeNegativeTest-471433960 Jun 29 08:13:22.709288 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Tenant-Id: a4df15f6a6dd45dab12d0b724076a23e Jun 29 08:13:22.709288 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-471433960 Jun 29 08:13:22.709288 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-User: tempest-AttachVolumeNegativeTest-471433960-project Jun 29 08:13:22.709288 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-User-Domain-Id: default Jun 29 08:13:22.709288 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-User-Domain-Name: Default Jun 29 08:13:22.709288 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-User-Id: 4873db0f2fbf4a77a617f2102a5ccfae Jun 29 08:13:22.709288 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-User-Name: tempest-AttachVolumeNegativeTest-471433960-project Jun 29 08:13:22.709288 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: method: > Jun 29 08:13:22.709288 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: exception: Instance 01330f68-42df-4986-b996-e6403d1555c6 could not be found. Jun 29 08:13:22.709288 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: action_args: {'id': '01330f68-42df-4986-b996-e6403d1555c6'} Jun 29 08:13:22.710303 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 08:13:22.710303 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:13:22.710303 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 29 08:13:22.710303 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 29 08:13:22.710303 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 29 08:13:22.710303 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 29 08:13:22.710303 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 29 08:13:22.710303 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 29 08:13:22.710303 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 29 08:13:22.710303 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 29 08:13:22.710303 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 01330f68-42df-4986-b996-e6403d1555c6 could not be found. Jun 29 08:13:22.710303 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 29 08:13:22.710303 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 08:13:22.710303 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 29 08:13:22.710303 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:13:22.710303 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 08:13:22.710303 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 08:13:22.710303 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 08:13:22.710303 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 08:13:22.710303 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 08:13:22.712492 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 08:13:22.712492 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 29 08:13:22.712492 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 29 08:13:22.712492 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 29 08:13:22.712492 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 29 08:13:22.712492 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 29 08:13:22.712492 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 29 08:13:22.712492 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 01330f68-42df-4986-b996-e6403d1555c6 could not be found. Jun 29 08:13:22.712492 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 29 08:13:22.712492 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 08:13:22.712492 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 29 08:13:22.712492 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:13:22.712492 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 08:13:22.712492 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 08:13:22.712492 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 08:13:22.712492 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 08:13:22.712492 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 01330f68-42df-4986-b996-e6403d1555c6 could not be found. Jun 29 08:13:22.712492 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 29 08:13:22.713867 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-97dc6d43-7ff1-4359-af22-3c1fd229b883 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Returning 404 to user: Instance 01330f68-42df-4986-b996-e6403d1555c6 could not be found. {{(pid=117890) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 08:13:22.713867 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-97dc6d43-7ff1-4359-af22-3c1fd229b883 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] 10.222.0.43 "GET /compute/v2.1/servers/01330f68-42df-4986-b996-e6403d1555c6" status: 404 len: 111 microversion: 2.1 time: 0.032152 Jun 29 08:13:22.713867 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 479/966] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:13:22 2022] GET /compute/v2.1/servers/01330f68-42df-4986-b996-e6403d1555c6 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 29 08:13:22.717624 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-1a8ce102-96cb-438c-a72a-4bfae605af15 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:13:22.718120 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-1a8ce102-96cb-438c-a72a-4bfae605af15 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] [instance: 7c7721f2-e567-4e6f-aefd-d852fa3fe37a] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:13:22.724473 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-1a8ce102-96cb-438c-a72a-4bfae605af15 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:13:22.724919 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-1a8ce102-96cb-438c-a72a-4bfae605af15 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:13:22.725720 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-1a8ce102-96cb-438c-a72a-4bfae605af15 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:13:22.726157 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-1a8ce102-96cb-438c-a72a-4bfae605af15 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:13:22.740958 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.wsgi [None req-1a8ce102-96cb-438c-a72a-4bfae605af15 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] HTTP exception thrown: Instance 7c7721f2-e567-4e6f-aefd-d852fa3fe37a could not be found. Jun 29 08:13:22.743029 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-1a8ce102-96cb-438c-a72a-4bfae605af15 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Request method failure captured: Jun 29 08:13:22.743029 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: request: DELETE /compute/v2.1/servers/7c7721f2-e567-4e6f-aefd-d852fa3fe37a HTTP/1.1 Jun 29 08:13:22.743029 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: Accept: application/json Jun 29 08:13:22.743029 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: Accept-Encoding: identity Jun 29 08:13:22.743029 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: Connection: close Jun 29 08:13:22.743029 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: Content-Length: 0 Jun 29 08:13:22.743029 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: Content-Type: application/json Jun 29 08:13:22.743029 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: Host: 10.222.0.43 Jun 29 08:13:22.743029 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: Openstack-System-Scope: None Jun 29 08:13:22.743029 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: User-Agent: python-urllib3/1.26.9 Jun 29 08:13:22.743029 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Auth-Token: gAAAAABivAiYnWOqjiwHcE1PCPUmCrIvEMkbVX7lWZxh9jPOZ_GtAOja07fGzXFEXqZ7Ky0xacgV6SGsTaq5tzX8bh-ZG0acOi-203kWLHdiaJ2wslMtHKMClYhsYgyOgs9fcpZ5v5SN8dlG-3pGiAd5z4Hj9kmL7TX1CMp1QfZwI7CaxfijbC4 Jun 29 08:13:22.743029 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Domain-Id: None Jun 29 08:13:22.743029 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Domain-Name: None Jun 29 08:13:22.743029 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Identity-Status: Confirmed Jun 29 08:13:22.743029 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Is-Admin-Project: True Jun 29 08:13:22.743029 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Project-Domain-Id: default Jun 29 08:13:22.743029 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Project-Domain-Name: Default Jun 29 08:13:22.743029 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Project-Id: a4df15f6a6dd45dab12d0b724076a23e Jun 29 08:13:22.743029 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Project-Name: tempest-AttachVolumeNegativeTest-471433960 Jun 29 08:13:22.743029 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Role: member,reader Jun 29 08:13:22.743029 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Roles: member,reader Jun 29 08:13:22.744740 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a4df15f6a6dd45dab12d0b724076a23e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_a4df15f6a6dd45dab12d0b724076a23e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a4df15f6a6dd45dab12d0b724076a23e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/a4df15f6a6dd45dab12d0b724076a23e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Jun 29 08:13:22.744740 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Tenant: tempest-AttachVolumeNegativeTest-471433960 Jun 29 08:13:22.744740 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Tenant-Id: a4df15f6a6dd45dab12d0b724076a23e Jun 29 08:13:22.744740 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-471433960 Jun 29 08:13:22.744740 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-User: tempest-AttachVolumeNegativeTest-471433960-project Jun 29 08:13:22.744740 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-User-Domain-Id: default Jun 29 08:13:22.744740 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-User-Domain-Name: Default Jun 29 08:13:22.744740 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-User-Id: 4873db0f2fbf4a77a617f2102a5ccfae Jun 29 08:13:22.744740 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-User-Name: tempest-AttachVolumeNegativeTest-471433960-project Jun 29 08:13:22.744740 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: method: > Jun 29 08:13:22.744740 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: exception: Instance 7c7721f2-e567-4e6f-aefd-d852fa3fe37a could not be found. Jun 29 08:13:22.744740 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: action_args: {'id': '7c7721f2-e567-4e6f-aefd-d852fa3fe37a'} Jun 29 08:13:22.745753 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 08:13:22.745753 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:13:22.745753 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 29 08:13:22.745753 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 29 08:13:22.745753 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 29 08:13:22.745753 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 29 08:13:22.745753 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 29 08:13:22.745753 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 29 08:13:22.745753 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 29 08:13:22.745753 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 29 08:13:22.745753 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7c7721f2-e567-4e6f-aefd-d852fa3fe37a could not be found. Jun 29 08:13:22.745753 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 29 08:13:22.745753 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 08:13:22.745753 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 29 08:13:22.745753 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:13:22.745753 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 08:13:22.745753 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 08:13:22.745753 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 08:13:22.745753 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 08:13:22.745753 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 08:13:22.747255 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 08:13:22.747255 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 29 08:13:22.747255 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 29 08:13:22.747255 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 29 08:13:22.747255 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 29 08:13:22.747255 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 29 08:13:22.747255 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 29 08:13:22.747255 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 29 08:13:22.747255 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 29 08:13:22.747255 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7c7721f2-e567-4e6f-aefd-d852fa3fe37a could not be found. Jun 29 08:13:22.747255 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 29 08:13:22.747255 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 08:13:22.747255 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 29 08:13:22.747255 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:13:22.747255 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 08:13:22.747255 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 08:13:22.747255 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 08:13:22.747255 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 08:13:22.747255 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7c7721f2-e567-4e6f-aefd-d852fa3fe37a could not be found. Jun 29 08:13:22.747255 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 29 08:13:22.748909 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-1a8ce102-96cb-438c-a72a-4bfae605af15 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Returning 404 to user: Instance 7c7721f2-e567-4e6f-aefd-d852fa3fe37a could not be found. {{(pid=117889) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 08:13:22.748909 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-1a8ce102-96cb-438c-a72a-4bfae605af15 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] 10.222.0.43 "DELETE /compute/v2.1/servers/7c7721f2-e567-4e6f-aefd-d852fa3fe37a" status: 404 len: 111 microversion: 2.1 time: 0.030818 Jun 29 08:13:22.748909 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 488/967] 10.222.0.43 () {58 vars in 1238 bytes} [Wed Jun 29 08:13:22 2022] DELETE /compute/v2.1/servers/7c7721f2-e567-4e6f-aefd-d852fa3fe37a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 29 08:13:22.753259 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-2ff3b19e-04a6-4789-8b19-814ea765fc1c tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:13:22.753881 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-2ff3b19e-04a6-4789-8b19-814ea765fc1c tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] [instance: 7c7721f2-e567-4e6f-aefd-d852fa3fe37a] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:13:22.760650 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-2ff3b19e-04a6-4789-8b19-814ea765fc1c tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:13:22.761131 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-2ff3b19e-04a6-4789-8b19-814ea765fc1c tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:13:22.761914 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-2ff3b19e-04a6-4789-8b19-814ea765fc1c tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:13:22.762355 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-2ff3b19e-04a6-4789-8b19-814ea765fc1c tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:13:22.776482 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.wsgi [None req-2ff3b19e-04a6-4789-8b19-814ea765fc1c tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] HTTP exception thrown: Instance 7c7721f2-e567-4e6f-aefd-d852fa3fe37a could not be found. Jun 29 08:13:22.778082 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-2ff3b19e-04a6-4789-8b19-814ea765fc1c tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Request method failure captured: Jun 29 08:13:22.778082 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: request: GET /compute/v2.1/servers/7c7721f2-e567-4e6f-aefd-d852fa3fe37a HTTP/1.1 Jun 29 08:13:22.778082 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: Accept: application/json Jun 29 08:13:22.778082 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: Accept-Encoding: identity Jun 29 08:13:22.778082 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: Connection: close Jun 29 08:13:22.778082 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: Content-Length: 0 Jun 29 08:13:22.778082 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: Content-Type: application/json Jun 29 08:13:22.778082 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: Host: 10.222.0.43 Jun 29 08:13:22.778082 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: Openstack-System-Scope: None Jun 29 08:13:22.778082 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: User-Agent: python-urllib3/1.26.9 Jun 29 08:13:22.778082 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Auth-Token: gAAAAABivAiYnWOqjiwHcE1PCPUmCrIvEMkbVX7lWZxh9jPOZ_GtAOja07fGzXFEXqZ7Ky0xacgV6SGsTaq5tzX8bh-ZG0acOi-203kWLHdiaJ2wslMtHKMClYhsYgyOgs9fcpZ5v5SN8dlG-3pGiAd5z4Hj9kmL7TX1CMp1QfZwI7CaxfijbC4 Jun 29 08:13:22.778082 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Domain-Id: None Jun 29 08:13:22.778082 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Domain-Name: None Jun 29 08:13:22.778082 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Identity-Status: Confirmed Jun 29 08:13:22.778082 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Is-Admin-Project: True Jun 29 08:13:22.778082 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Project-Domain-Id: default Jun 29 08:13:22.778082 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Project-Domain-Name: Default Jun 29 08:13:22.778082 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Project-Id: a4df15f6a6dd45dab12d0b724076a23e Jun 29 08:13:22.778082 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Project-Name: tempest-AttachVolumeNegativeTest-471433960 Jun 29 08:13:22.778082 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Role: member,reader Jun 29 08:13:22.778082 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Roles: member,reader Jun 29 08:13:22.780364 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a4df15f6a6dd45dab12d0b724076a23e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_a4df15f6a6dd45dab12d0b724076a23e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a4df15f6a6dd45dab12d0b724076a23e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/a4df15f6a6dd45dab12d0b724076a23e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Jun 29 08:13:22.780364 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Tenant: tempest-AttachVolumeNegativeTest-471433960 Jun 29 08:13:22.780364 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Tenant-Id: a4df15f6a6dd45dab12d0b724076a23e Jun 29 08:13:22.780364 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-471433960 Jun 29 08:13:22.780364 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-User: tempest-AttachVolumeNegativeTest-471433960-project Jun 29 08:13:22.780364 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-User-Domain-Id: default Jun 29 08:13:22.780364 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-User-Domain-Name: Default Jun 29 08:13:22.780364 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-User-Id: 4873db0f2fbf4a77a617f2102a5ccfae Jun 29 08:13:22.780364 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-User-Name: tempest-AttachVolumeNegativeTest-471433960-project Jun 29 08:13:22.780364 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: method: > Jun 29 08:13:22.780364 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: exception: Instance 7c7721f2-e567-4e6f-aefd-d852fa3fe37a could not be found. Jun 29 08:13:22.780364 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: action_args: {'id': '7c7721f2-e567-4e6f-aefd-d852fa3fe37a'} Jun 29 08:13:22.781338 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 08:13:22.781338 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:13:22.781338 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 29 08:13:22.781338 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 29 08:13:22.781338 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 29 08:13:22.781338 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 29 08:13:22.781338 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 29 08:13:22.781338 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 29 08:13:22.781338 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 29 08:13:22.781338 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 29 08:13:22.781338 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7c7721f2-e567-4e6f-aefd-d852fa3fe37a could not be found. Jun 29 08:13:22.781338 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 29 08:13:22.781338 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 08:13:22.781338 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 29 08:13:22.781338 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:13:22.781338 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 08:13:22.781338 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 08:13:22.781338 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 08:13:22.781338 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 08:13:22.781338 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 08:13:22.782977 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 08:13:22.782977 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 29 08:13:22.782977 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 29 08:13:22.782977 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 29 08:13:22.782977 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 29 08:13:22.782977 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 29 08:13:22.782977 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 29 08:13:22.782977 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7c7721f2-e567-4e6f-aefd-d852fa3fe37a could not be found. Jun 29 08:13:22.782977 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 29 08:13:22.782977 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 08:13:22.782977 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 29 08:13:22.782977 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:13:22.782977 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 08:13:22.782977 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 08:13:22.782977 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 08:13:22.782977 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 08:13:22.782977 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7c7721f2-e567-4e6f-aefd-d852fa3fe37a could not be found. Jun 29 08:13:22.782977 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 29 08:13:22.784373 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-2ff3b19e-04a6-4789-8b19-814ea765fc1c tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Returning 404 to user: Instance 7c7721f2-e567-4e6f-aefd-d852fa3fe37a could not be found. {{(pid=117890) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 08:13:22.784373 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-2ff3b19e-04a6-4789-8b19-814ea765fc1c tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] 10.222.0.43 "GET /compute/v2.1/servers/7c7721f2-e567-4e6f-aefd-d852fa3fe37a" status: 404 len: 111 microversion: 2.1 time: 0.030174 Jun 29 08:13:22.784373 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 480/968] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:13:22 2022] GET /compute/v2.1/servers/7c7721f2-e567-4e6f-aefd-d852fa3fe37a => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 29 08:13:23.922163 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-9dfcc0c1-6c0a-49a1-9cb5-74db2b72cd0e tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:13:23.922776 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-9dfcc0c1-6c0a-49a1-9cb5-74db2b72cd0e tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] [instance: 57b6d980-40de-4505-a591-20b54645d37c] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:13:23.930463 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-9dfcc0c1-6c0a-49a1-9cb5-74db2b72cd0e tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:13:23.930920 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-9dfcc0c1-6c0a-49a1-9cb5-74db2b72cd0e tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:13:23.931707 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-9dfcc0c1-6c0a-49a1-9cb5-74db2b72cd0e tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:13:23.932156 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-9dfcc0c1-6c0a-49a1-9cb5-74db2b72cd0e tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:13:23.950395 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.wsgi [None req-9dfcc0c1-6c0a-49a1-9cb5-74db2b72cd0e tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] HTTP exception thrown: Instance 57b6d980-40de-4505-a591-20b54645d37c could not be found. Jun 29 08:13:23.951972 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-9dfcc0c1-6c0a-49a1-9cb5-74db2b72cd0e tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Request method failure captured: Jun 29 08:13:23.951972 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: request: DELETE /compute/v2.1/servers/57b6d980-40de-4505-a591-20b54645d37c HTTP/1.1 Jun 29 08:13:23.951972 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: Accept: application/json Jun 29 08:13:23.951972 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: Accept-Encoding: identity Jun 29 08:13:23.951972 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: Connection: close Jun 29 08:13:23.951972 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: Content-Length: 0 Jun 29 08:13:23.951972 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: Content-Type: application/json Jun 29 08:13:23.951972 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: Host: 10.222.0.43 Jun 29 08:13:23.951972 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: Openstack-System-Scope: None Jun 29 08:13:23.951972 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: User-Agent: python-urllib3/1.26.9 Jun 29 08:13:23.951972 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Auth-Token: gAAAAABivAiYnWOqjiwHcE1PCPUmCrIvEMkbVX7lWZxh9jPOZ_GtAOja07fGzXFEXqZ7Ky0xacgV6SGsTaq5tzX8bh-ZG0acOi-203kWLHdiaJ2wslMtHKMClYhsYgyOgs9fcpZ5v5SN8dlG-3pGiAd5z4Hj9kmL7TX1CMp1QfZwI7CaxfijbC4 Jun 29 08:13:23.951972 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Domain-Id: None Jun 29 08:13:23.951972 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Domain-Name: None Jun 29 08:13:23.951972 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Identity-Status: Confirmed Jun 29 08:13:23.951972 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Is-Admin-Project: True Jun 29 08:13:23.951972 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Project-Domain-Id: default Jun 29 08:13:23.951972 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Project-Domain-Name: Default Jun 29 08:13:23.951972 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Project-Id: a4df15f6a6dd45dab12d0b724076a23e Jun 29 08:13:23.951972 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Project-Name: tempest-AttachVolumeNegativeTest-471433960 Jun 29 08:13:23.951972 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Role: member,reader Jun 29 08:13:23.951972 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Roles: member,reader Jun 29 08:13:23.953602 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a4df15f6a6dd45dab12d0b724076a23e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_a4df15f6a6dd45dab12d0b724076a23e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a4df15f6a6dd45dab12d0b724076a23e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/a4df15f6a6dd45dab12d0b724076a23e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Jun 29 08:13:23.953602 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Tenant: tempest-AttachVolumeNegativeTest-471433960 Jun 29 08:13:23.953602 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Tenant-Id: a4df15f6a6dd45dab12d0b724076a23e Jun 29 08:13:23.953602 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-471433960 Jun 29 08:13:23.953602 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-User: tempest-AttachVolumeNegativeTest-471433960-project Jun 29 08:13:23.953602 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-User-Domain-Id: default Jun 29 08:13:23.953602 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-User-Domain-Name: Default Jun 29 08:13:23.953602 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-User-Id: 4873db0f2fbf4a77a617f2102a5ccfae Jun 29 08:13:23.953602 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-User-Name: tempest-AttachVolumeNegativeTest-471433960-project Jun 29 08:13:23.953602 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: method: > Jun 29 08:13:23.953602 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: exception: Instance 57b6d980-40de-4505-a591-20b54645d37c could not be found. Jun 29 08:13:23.953602 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: action_args: {'id': '57b6d980-40de-4505-a591-20b54645d37c'} Jun 29 08:13:23.954660 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 08:13:23.954660 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:13:23.954660 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 29 08:13:23.954660 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 29 08:13:23.954660 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 29 08:13:23.954660 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 29 08:13:23.954660 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 29 08:13:23.954660 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 29 08:13:23.954660 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 29 08:13:23.954660 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 29 08:13:23.954660 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 57b6d980-40de-4505-a591-20b54645d37c could not be found. Jun 29 08:13:23.954660 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 29 08:13:23.954660 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 08:13:23.954660 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 29 08:13:23.954660 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:13:23.954660 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 08:13:23.954660 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 08:13:23.954660 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 08:13:23.954660 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 08:13:23.954660 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 08:13:23.956163 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 08:13:23.956163 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 29 08:13:23.956163 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 29 08:13:23.956163 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 29 08:13:23.956163 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 29 08:13:23.956163 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 29 08:13:23.956163 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 29 08:13:23.956163 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 29 08:13:23.956163 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 29 08:13:23.956163 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 57b6d980-40de-4505-a591-20b54645d37c could not be found. Jun 29 08:13:23.956163 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 29 08:13:23.956163 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 08:13:23.956163 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 29 08:13:23.956163 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:13:23.956163 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 08:13:23.956163 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 08:13:23.956163 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 08:13:23.956163 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 08:13:23.956163 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 57b6d980-40de-4505-a591-20b54645d37c could not be found. Jun 29 08:13:23.956163 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 29 08:13:23.957795 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-9dfcc0c1-6c0a-49a1-9cb5-74db2b72cd0e tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Returning 404 to user: Instance 57b6d980-40de-4505-a591-20b54645d37c could not be found. {{(pid=117889) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 08:13:23.957795 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-9dfcc0c1-6c0a-49a1-9cb5-74db2b72cd0e tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] 10.222.0.43 "DELETE /compute/v2.1/servers/57b6d980-40de-4505-a591-20b54645d37c" status: 404 len: 111 microversion: 2.1 time: 0.035208 Jun 29 08:13:23.957795 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 489/969] 10.222.0.43 () {58 vars in 1238 bytes} [Wed Jun 29 08:13:23 2022] DELETE /compute/v2.1/servers/57b6d980-40de-4505-a591-20b54645d37c => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 29 08:13:23.963455 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-5ca5351c-f8f9-4eb1-b080-e74f6a95aea4 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:13:23.964062 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-5ca5351c-f8f9-4eb1-b080-e74f6a95aea4 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] [instance: 57b6d980-40de-4505-a591-20b54645d37c] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:13:23.970570 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-5ca5351c-f8f9-4eb1-b080-e74f6a95aea4 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:13:23.971148 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-5ca5351c-f8f9-4eb1-b080-e74f6a95aea4 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:13:23.971923 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-5ca5351c-f8f9-4eb1-b080-e74f6a95aea4 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:13:23.972356 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-5ca5351c-f8f9-4eb1-b080-e74f6a95aea4 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:13:23.986825 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.wsgi [None req-5ca5351c-f8f9-4eb1-b080-e74f6a95aea4 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] HTTP exception thrown: Instance 57b6d980-40de-4505-a591-20b54645d37c could not be found. Jun 29 08:13:23.988409 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-5ca5351c-f8f9-4eb1-b080-e74f6a95aea4 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Request method failure captured: Jun 29 08:13:23.988409 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: request: GET /compute/v2.1/servers/57b6d980-40de-4505-a591-20b54645d37c HTTP/1.1 Jun 29 08:13:23.988409 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: Accept: application/json Jun 29 08:13:23.988409 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: Accept-Encoding: identity Jun 29 08:13:23.988409 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: Connection: close Jun 29 08:13:23.988409 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: Content-Length: 0 Jun 29 08:13:23.988409 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: Content-Type: application/json Jun 29 08:13:23.988409 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: Host: 10.222.0.43 Jun 29 08:13:23.988409 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: Openstack-System-Scope: None Jun 29 08:13:23.988409 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: User-Agent: python-urllib3/1.26.9 Jun 29 08:13:23.988409 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Auth-Token: gAAAAABivAiYnWOqjiwHcE1PCPUmCrIvEMkbVX7lWZxh9jPOZ_GtAOja07fGzXFEXqZ7Ky0xacgV6SGsTaq5tzX8bh-ZG0acOi-203kWLHdiaJ2wslMtHKMClYhsYgyOgs9fcpZ5v5SN8dlG-3pGiAd5z4Hj9kmL7TX1CMp1QfZwI7CaxfijbC4 Jun 29 08:13:23.988409 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Domain-Id: None Jun 29 08:13:23.988409 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Domain-Name: None Jun 29 08:13:23.988409 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Identity-Status: Confirmed Jun 29 08:13:23.988409 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Is-Admin-Project: True Jun 29 08:13:23.988409 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Project-Domain-Id: default Jun 29 08:13:23.988409 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Project-Domain-Name: Default Jun 29 08:13:23.988409 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Project-Id: a4df15f6a6dd45dab12d0b724076a23e Jun 29 08:13:23.988409 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Project-Name: tempest-AttachVolumeNegativeTest-471433960 Jun 29 08:13:23.988409 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Role: member,reader Jun 29 08:13:23.988409 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Roles: member,reader Jun 29 08:13:23.990086 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a4df15f6a6dd45dab12d0b724076a23e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_a4df15f6a6dd45dab12d0b724076a23e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/a4df15f6a6dd45dab12d0b724076a23e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/a4df15f6a6dd45dab12d0b724076a23e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Jun 29 08:13:23.990086 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Tenant: tempest-AttachVolumeNegativeTest-471433960 Jun 29 08:13:23.990086 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Tenant-Id: a4df15f6a6dd45dab12d0b724076a23e Jun 29 08:13:23.990086 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-471433960 Jun 29 08:13:23.990086 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-User: tempest-AttachVolumeNegativeTest-471433960-project Jun 29 08:13:23.990086 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-User-Domain-Id: default Jun 29 08:13:23.990086 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-User-Domain-Name: Default Jun 29 08:13:23.990086 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-User-Id: 4873db0f2fbf4a77a617f2102a5ccfae Jun 29 08:13:23.990086 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-User-Name: tempest-AttachVolumeNegativeTest-471433960-project Jun 29 08:13:23.990086 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: method: > Jun 29 08:13:23.990086 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: exception: Instance 57b6d980-40de-4505-a591-20b54645d37c could not be found. Jun 29 08:13:23.990086 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: action_args: {'id': '57b6d980-40de-4505-a591-20b54645d37c'} Jun 29 08:13:23.992302 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 08:13:23.992302 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:13:23.992302 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 29 08:13:23.992302 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 29 08:13:23.992302 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 29 08:13:23.992302 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 29 08:13:23.992302 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 29 08:13:23.992302 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 29 08:13:23.992302 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 29 08:13:23.992302 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 29 08:13:23.992302 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 57b6d980-40de-4505-a591-20b54645d37c could not be found. Jun 29 08:13:23.992302 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 29 08:13:23.992302 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 08:13:23.992302 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 29 08:13:23.992302 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:13:23.992302 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 08:13:23.992302 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 08:13:23.992302 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 08:13:23.992302 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 08:13:23.992302 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 08:13:23.993836 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 08:13:23.993836 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 29 08:13:23.993836 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 29 08:13:23.993836 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 29 08:13:23.993836 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 29 08:13:23.993836 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 29 08:13:23.993836 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 29 08:13:23.993836 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 57b6d980-40de-4505-a591-20b54645d37c could not be found. Jun 29 08:13:23.993836 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 29 08:13:23.993836 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 08:13:23.993836 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 29 08:13:23.993836 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:13:23.993836 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 08:13:23.993836 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 08:13:23.993836 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 08:13:23.993836 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 08:13:23.993836 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 57b6d980-40de-4505-a591-20b54645d37c could not be found. Jun 29 08:13:23.993836 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 29 08:13:23.995538 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-5ca5351c-f8f9-4eb1-b080-e74f6a95aea4 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] Returning 404 to user: Instance 57b6d980-40de-4505-a591-20b54645d37c could not be found. {{(pid=117890) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 08:13:23.995538 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-5ca5351c-f8f9-4eb1-b080-e74f6a95aea4 tempest-AttachVolumeNegativeTest-471433960 tempest-AttachVolumeNegativeTest-471433960-project] 10.222.0.43 "GET /compute/v2.1/servers/57b6d980-40de-4505-a591-20b54645d37c" status: 404 len: 111 microversion: 2.1 time: 0.031153 Jun 29 08:13:23.995538 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 481/970] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:13:23 2022] GET /compute/v2.1/servers/57b6d980-40de-4505-a591-20b54645d37c => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 29 08:13:28.570284 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-1d38720c-eba7-4797-9ad2-6698e3a1506c tempest-VolumesNegativeTest-730954138 tempest-VolumesNegativeTest-730954138-project] Action: 'create', calling method: .version_select at 0x7f72412e9e50>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1073449657", "metadata": {"Type": "work"}}} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:13:28.596949 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-1d38720c-eba7-4797-9ad2-6698e3a1506c tempest-VolumesNegativeTest-730954138 tempest-VolumesNegativeTest-730954138-project] Request method failure captured: Jun 29 08:13:28.596949 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 29 08:13:28.596949 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: Accept: application/json Jun 29 08:13:28.596949 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: Accept-Encoding: identity Jun 29 08:13:28.596949 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: Connection: close Jun 29 08:13:28.596949 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: Content-Length: 122 Jun 29 08:13:28.596949 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: Content-Type: application/json Jun 29 08:13:28.596949 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: Host: 10.222.0.43 Jun 29 08:13:28.596949 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: Openstack-System-Scope: None Jun 29 08:13:28.596949 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: User-Agent: python-urllib3/1.26.9 Jun 29 08:13:28.596949 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Auth-Token: gAAAAABivAmorsOfMRGLnvnVOkJhkfyWLhLWTUCNBa0PrZ1bt4Wr7rnXRwkkgM8rwG2jbiZ0PwRSdwiHUJFNPIFGHOM9BqSwoAvTkvgqL5ROnaCRBVNpxcv1IvmZna0IMLAM5ZK-e4AGYyZLv8K5DfDN-jclPfqg9hSKxGb10fsca4F9ghEuXsg Jun 29 08:13:28.596949 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Domain-Id: None Jun 29 08:13:28.596949 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Domain-Name: None Jun 29 08:13:28.596949 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Identity-Status: Confirmed Jun 29 08:13:28.596949 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Is-Admin-Project: True Jun 29 08:13:28.596949 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Project-Domain-Id: default Jun 29 08:13:28.596949 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Project-Domain-Name: Default Jun 29 08:13:28.596949 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Project-Id: c2499d2faee84edda5f26ec0d21aecbb Jun 29 08:13:28.596949 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Project-Name: tempest-VolumesNegativeTest-730954138 Jun 29 08:13:28.596949 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Role: member,reader Jun 29 08:13:28.596949 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Roles: member,reader Jun 29 08:13:28.598754 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/c2499d2faee84edda5f26ec0d21aecbb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_c2499d2faee84edda5f26ec0d21aecbb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/c2499d2faee84edda5f26ec0d21aecbb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/c2499d2faee84edda5f26ec0d21aecbb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Jun 29 08:13:28.598754 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Tenant: tempest-VolumesNegativeTest-730954138 Jun 29 08:13:28.598754 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Tenant-Id: c2499d2faee84edda5f26ec0d21aecbb Jun 29 08:13:28.598754 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Tenant-Name: tempest-VolumesNegativeTest-730954138 Jun 29 08:13:28.598754 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-User: tempest-VolumesNegativeTest-730954138-project Jun 29 08:13:28.598754 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-User-Domain-Id: default Jun 29 08:13:28.598754 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-User-Domain-Name: Default Jun 29 08:13:28.598754 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-User-Id: 8f84036eb86b4907a20d46978920eadd Jun 29 08:13:28.598754 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-User-Name: tempest-VolumesNegativeTest-730954138-project Jun 29 08:13:28.598754 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: Jun 29 08:13:28.598754 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1073449657", "metadata": {"Type": "work"}}} Jun 29 08:13:28.598754 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: method: Jun 29 08:13:28.598754 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 29 08:13:28.599764 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1073449657', 'metadata': {'Type': 'work'}}}} Jun 29 08:13:28.599764 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 08:13:28.599764 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:13:28.599764 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 29 08:13:28.599764 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 29 08:13:28.599764 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 29 08:13:28.599764 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise error Jun 29 08:13:28.599764 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jun 29 08:13:28.599764 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 29 08:13:28.599764 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 29 08:13:28.599764 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 29 08:13:28.599764 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 29 08:13:28.599764 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 29 08:13:28.599764 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi '#$%' Jun 29 08:13:28.599764 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 29 08:13:28.599764 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 08:13:28.599764 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 29 08:13:28.599764 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:13:28.599764 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 08:13:28.599764 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 08:13:28.599764 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 08:13:28.599764 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 08:13:28.601807 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 29 08:13:28.601807 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 29 08:13:28.601807 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 08:13:28.601807 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 08:13:28.601807 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 29 08:13:28.601807 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 29 08:13:28.601807 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 29 08:13:28.601807 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 29 08:13:28.601807 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 29 08:13:28.601807 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 29 08:13:28.601807 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 29 08:13:28.601807 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 29 08:13:28.601807 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 08:13:28.601807 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 29 08:13:28.601807 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:13:28.601807 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 08:13:28.601807 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 08:13:28.601807 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 29 08:13:28.601807 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 29 08:13:28.603095 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 29 08:13:28.603095 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 29 08:13:28.603095 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-1d38720c-eba7-4797-9ad2-6698e3a1506c tempest-VolumesNegativeTest-730954138 tempest-VolumesNegativeTest-730954138-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=117889) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 08:13:28.603095 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-1d38720c-eba7-4797-9ad2-6698e3a1506c tempest-VolumesNegativeTest-730954138 tempest-VolumesNegativeTest-730954138-project] 10.222.0.43 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.150898 Jun 29 08:13:28.603095 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 490/971] 10.222.0.43 () {60 vars in 1155 bytes} [Wed Jun 29 08:13:28 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 152 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 29 08:13:28.611132 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-2fe9e64a-67e6-41fd-b53c-40144c492263 tempest-VolumesNegativeTest-730954138 tempest-VolumesNegativeTest-730954138-project] Action: 'create', calling method: .version_select at 0x7f7241237700>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-434066461", "metadata": {"Type": "work"}}} {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:13:28.613314 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-2fe9e64a-67e6-41fd-b53c-40144c492263 tempest-VolumesNegativeTest-730954138 tempest-VolumesNegativeTest-730954138-project] Request method failure captured: Jun 29 08:13:28.613314 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 29 08:13:28.613314 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: Accept: application/json Jun 29 08:13:28.613314 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: Accept-Encoding: identity Jun 29 08:13:28.613314 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: Connection: close Jun 29 08:13:28.613314 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: Content-Length: 119 Jun 29 08:13:28.613314 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: Content-Type: application/json Jun 29 08:13:28.613314 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: Host: 10.222.0.43 Jun 29 08:13:28.613314 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: Openstack-System-Scope: None Jun 29 08:13:28.613314 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: User-Agent: python-urllib3/1.26.9 Jun 29 08:13:28.613314 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Auth-Token: gAAAAABivAmorsOfMRGLnvnVOkJhkfyWLhLWTUCNBa0PrZ1bt4Wr7rnXRwkkgM8rwG2jbiZ0PwRSdwiHUJFNPIFGHOM9BqSwoAvTkvgqL5ROnaCRBVNpxcv1IvmZna0IMLAM5ZK-e4AGYyZLv8K5DfDN-jclPfqg9hSKxGb10fsca4F9ghEuXsg Jun 29 08:13:28.613314 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Domain-Id: None Jun 29 08:13:28.613314 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Domain-Name: None Jun 29 08:13:28.613314 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Identity-Status: Confirmed Jun 29 08:13:28.613314 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Is-Admin-Project: True Jun 29 08:13:28.613314 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Project-Domain-Id: default Jun 29 08:13:28.613314 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Project-Domain-Name: Default Jun 29 08:13:28.613314 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Project-Id: c2499d2faee84edda5f26ec0d21aecbb Jun 29 08:13:28.613314 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Project-Name: tempest-VolumesNegativeTest-730954138 Jun 29 08:13:28.613314 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Role: member,reader Jun 29 08:13:28.613314 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Roles: member,reader Jun 29 08:13:28.614763 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/c2499d2faee84edda5f26ec0d21aecbb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_c2499d2faee84edda5f26ec0d21aecbb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/c2499d2faee84edda5f26ec0d21aecbb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/c2499d2faee84edda5f26ec0d21aecbb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Jun 29 08:13:28.614763 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Tenant: tempest-VolumesNegativeTest-730954138 Jun 29 08:13:28.614763 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Tenant-Id: c2499d2faee84edda5f26ec0d21aecbb Jun 29 08:13:28.614763 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Tenant-Name: tempest-VolumesNegativeTest-730954138 Jun 29 08:13:28.614763 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-User: tempest-VolumesNegativeTest-730954138-project Jun 29 08:13:28.614763 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-User-Domain-Id: default Jun 29 08:13:28.614763 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-User-Domain-Name: Default Jun 29 08:13:28.614763 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-User-Id: 8f84036eb86b4907a20d46978920eadd Jun 29 08:13:28.614763 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-User-Name: tempest-VolumesNegativeTest-730954138-project Jun 29 08:13:28.614763 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: Jun 29 08:13:28.614763 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-434066461", "metadata": {"Type": "work"}}} Jun 29 08:13:28.614763 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: method: Jun 29 08:13:28.614763 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 29 08:13:28.615648 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-434066461', 'metadata': {'Type': 'work'}}}} Jun 29 08:13:28.615648 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 08:13:28.615648 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:13:28.615648 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 29 08:13:28.615648 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 29 08:13:28.615648 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 29 08:13:28.615648 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi raise error Jun 29 08:13:28.615648 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jun 29 08:13:28.615648 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 29 08:13:28.615648 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jun 29 08:13:28.615648 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 29 08:13:28.615648 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 29 08:13:28.615648 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 29 08:13:28.615648 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi '0' Jun 29 08:13:28.615648 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 29 08:13:28.615648 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 08:13:28.615648 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 29 08:13:28.615648 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:13:28.615648 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 08:13:28.615648 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 08:13:28.615648 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 08:13:28.615648 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 08:13:28.619846 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 29 08:13:28.619846 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 29 08:13:28.619846 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 08:13:28.619846 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 08:13:28.619846 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 29 08:13:28.619846 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 29 08:13:28.619846 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 29 08:13:28.619846 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 29 08:13:28.619846 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 29 08:13:28.619846 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 29 08:13:28.619846 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 29 08:13:28.619846 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 29 08:13:28.619846 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 08:13:28.619846 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 29 08:13:28.619846 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:13:28.619846 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 08:13:28.619846 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 08:13:28.619846 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 29 08:13:28.619846 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 29 08:13:28.621502 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 29 08:13:28.621502 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 29 08:13:28.621502 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-2fe9e64a-67e6-41fd-b53c-40144c492263 tempest-VolumesNegativeTest-730954138 tempest-VolumesNegativeTest-730954138-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=117890) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 08:13:28.621502 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-2fe9e64a-67e6-41fd-b53c-40144c492263 tempest-VolumesNegativeTest-730954138 tempest-VolumesNegativeTest-730954138-project] 10.222.0.43 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.008753 Jun 29 08:13:28.621502 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 482/972] 10.222.0.43 () {60 vars in 1155 bytes} [Wed Jun 29 08:13:28 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 29 08:13:28.624718 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-0dcf44a5-0ae7-4dcb-b35c-0f233d8cfb32 tempest-VolumesNegativeTest-730954138 tempest-VolumesNegativeTest-730954138-project] Action: 'create', calling method: .version_select at 0x7f7241185700>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-3924276", "metadata": {"Type": "work"}}} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:13:28.627868 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-0dcf44a5-0ae7-4dcb-b35c-0f233d8cfb32 tempest-VolumesNegativeTest-730954138 tempest-VolumesNegativeTest-730954138-project] Request method failure captured: Jun 29 08:13:28.627868 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 29 08:13:28.627868 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: Accept: application/json Jun 29 08:13:28.627868 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: Accept-Encoding: identity Jun 29 08:13:28.627868 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: Connection: close Jun 29 08:13:28.627868 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: Content-Length: 116 Jun 29 08:13:28.627868 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: Content-Type: application/json Jun 29 08:13:28.627868 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: Host: 10.222.0.43 Jun 29 08:13:28.627868 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: Openstack-System-Scope: None Jun 29 08:13:28.627868 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: User-Agent: python-urllib3/1.26.9 Jun 29 08:13:28.627868 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Auth-Token: gAAAAABivAmorsOfMRGLnvnVOkJhkfyWLhLWTUCNBa0PrZ1bt4Wr7rnXRwkkgM8rwG2jbiZ0PwRSdwiHUJFNPIFGHOM9BqSwoAvTkvgqL5ROnaCRBVNpxcv1IvmZna0IMLAM5ZK-e4AGYyZLv8K5DfDN-jclPfqg9hSKxGb10fsca4F9ghEuXsg Jun 29 08:13:28.627868 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Domain-Id: None Jun 29 08:13:28.627868 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Domain-Name: None Jun 29 08:13:28.627868 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Identity-Status: Confirmed Jun 29 08:13:28.627868 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Is-Admin-Project: True Jun 29 08:13:28.627868 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Project-Domain-Id: default Jun 29 08:13:28.627868 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Project-Domain-Name: Default Jun 29 08:13:28.627868 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Project-Id: c2499d2faee84edda5f26ec0d21aecbb Jun 29 08:13:28.627868 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Project-Name: tempest-VolumesNegativeTest-730954138 Jun 29 08:13:28.627868 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Role: member,reader Jun 29 08:13:28.627868 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Roles: member,reader Jun 29 08:13:28.629564 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/c2499d2faee84edda5f26ec0d21aecbb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_c2499d2faee84edda5f26ec0d21aecbb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/c2499d2faee84edda5f26ec0d21aecbb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/c2499d2faee84edda5f26ec0d21aecbb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Jun 29 08:13:28.629564 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Tenant: tempest-VolumesNegativeTest-730954138 Jun 29 08:13:28.629564 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Tenant-Id: c2499d2faee84edda5f26ec0d21aecbb Jun 29 08:13:28.629564 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Tenant-Name: tempest-VolumesNegativeTest-730954138 Jun 29 08:13:28.629564 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-User: tempest-VolumesNegativeTest-730954138-project Jun 29 08:13:28.629564 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-User-Domain-Id: default Jun 29 08:13:28.629564 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-User-Domain-Name: Default Jun 29 08:13:28.629564 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-User-Id: 8f84036eb86b4907a20d46978920eadd Jun 29 08:13:28.629564 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-User-Name: tempest-VolumesNegativeTest-730954138-project Jun 29 08:13:28.629564 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: Jun 29 08:13:28.629564 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-3924276", "metadata": {"Type": "work"}}} Jun 29 08:13:28.629564 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: method: Jun 29 08:13:28.629564 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 29 08:13:28.631374 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-3924276', 'metadata': {'Type': 'work'}}}} Jun 29 08:13:28.631374 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 08:13:28.631374 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:13:28.631374 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 29 08:13:28.631374 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 29 08:13:28.631374 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 29 08:13:28.631374 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise error Jun 29 08:13:28.631374 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jun 29 08:13:28.631374 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 29 08:13:28.631374 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 29 08:13:28.631374 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 29 08:13:28.631374 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 29 08:13:28.631374 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 29 08:13:28.631374 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi '' Jun 29 08:13:28.631374 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 29 08:13:28.631374 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 08:13:28.631374 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 29 08:13:28.631374 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:13:28.631374 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 08:13:28.631374 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 08:13:28.631374 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 08:13:28.631374 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 08:13:28.633961 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 29 08:13:28.633961 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 29 08:13:28.633961 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 08:13:28.633961 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 08:13:28.633961 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 29 08:13:28.633961 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 29 08:13:28.633961 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 29 08:13:28.633961 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 29 08:13:28.633961 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 29 08:13:28.633961 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 29 08:13:28.633961 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 29 08:13:28.633961 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 29 08:13:28.633961 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 08:13:28.633961 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 29 08:13:28.633961 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:13:28.633961 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 08:13:28.633961 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 08:13:28.633961 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 29 08:13:28.633961 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 29 08:13:28.635440 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 29 08:13:28.635440 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 29 08:13:28.635440 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-0dcf44a5-0ae7-4dcb-b35c-0f233d8cfb32 tempest-VolumesNegativeTest-730954138 tempest-VolumesNegativeTest-730954138-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=117889) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 08:13:28.635440 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-0dcf44a5-0ae7-4dcb-b35c-0f233d8cfb32 tempest-VolumesNegativeTest-730954138 tempest-VolumesNegativeTest-730954138-project] 10.222.0.43 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.008328 Jun 29 08:13:28.635440 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 491/973] 10.222.0.43 () {60 vars in 1155 bytes} [Wed Jun 29 08:13:28 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 29 08:13:28.641419 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-1dd9bb3b-5865-4047-9506-fc92715ff10f tempest-VolumesNegativeTest-730954138 tempest-VolumesNegativeTest-730954138-project] Calling method '.version_select at 0x7f724122fdc0>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:13:28.673341 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.wsgi [None req-1dd9bb3b-5865-4047-9506-fc92715ff10f tempest-VolumesNegativeTest-730954138 tempest-VolumesNegativeTest-730954138-project] HTTP exception thrown: Volume tempest-invalid-203815724 could not be found. Jun 29 08:13:28.675257 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-1dd9bb3b-5865-4047-9506-fc92715ff10f tempest-VolumesNegativeTest-730954138 tempest-VolumesNegativeTest-730954138-project] Request method failure captured: Jun 29 08:13:28.675257 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-203815724 HTTP/1.1 Jun 29 08:13:28.675257 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: Accept: application/json Jun 29 08:13:28.675257 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: Accept-Encoding: identity Jun 29 08:13:28.675257 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: Connection: close Jun 29 08:13:28.675257 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: Content-Length: 0 Jun 29 08:13:28.675257 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: Content-Type: application/json Jun 29 08:13:28.675257 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: Host: 10.222.0.43 Jun 29 08:13:28.675257 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: Openstack-System-Scope: None Jun 29 08:13:28.675257 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: User-Agent: python-urllib3/1.26.9 Jun 29 08:13:28.675257 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Auth-Token: gAAAAABivAmorsOfMRGLnvnVOkJhkfyWLhLWTUCNBa0PrZ1bt4Wr7rnXRwkkgM8rwG2jbiZ0PwRSdwiHUJFNPIFGHOM9BqSwoAvTkvgqL5ROnaCRBVNpxcv1IvmZna0IMLAM5ZK-e4AGYyZLv8K5DfDN-jclPfqg9hSKxGb10fsca4F9ghEuXsg Jun 29 08:13:28.675257 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Domain-Id: None Jun 29 08:13:28.675257 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Domain-Name: None Jun 29 08:13:28.675257 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Identity-Status: Confirmed Jun 29 08:13:28.675257 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Is-Admin-Project: True Jun 29 08:13:28.675257 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Project-Domain-Id: default Jun 29 08:13:28.675257 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Project-Domain-Name: Default Jun 29 08:13:28.675257 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Project-Id: c2499d2faee84edda5f26ec0d21aecbb Jun 29 08:13:28.675257 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Project-Name: tempest-VolumesNegativeTest-730954138 Jun 29 08:13:28.675257 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Role: member,reader Jun 29 08:13:28.675257 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Roles: member,reader Jun 29 08:13:28.677138 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/c2499d2faee84edda5f26ec0d21aecbb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_c2499d2faee84edda5f26ec0d21aecbb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/c2499d2faee84edda5f26ec0d21aecbb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/c2499d2faee84edda5f26ec0d21aecbb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Jun 29 08:13:28.677138 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Tenant: tempest-VolumesNegativeTest-730954138 Jun 29 08:13:28.677138 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Tenant-Id: c2499d2faee84edda5f26ec0d21aecbb Jun 29 08:13:28.677138 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Tenant-Name: tempest-VolumesNegativeTest-730954138 Jun 29 08:13:28.677138 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-User: tempest-VolumesNegativeTest-730954138-project Jun 29 08:13:28.677138 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-User-Domain-Id: default Jun 29 08:13:28.677138 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-User-Domain-Name: Default Jun 29 08:13:28.677138 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-User-Id: 8f84036eb86b4907a20d46978920eadd Jun 29 08:13:28.677138 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-User-Name: tempest-VolumesNegativeTest-730954138-project Jun 29 08:13:28.677138 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: method: Jun 29 08:13:28.677138 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: exception: Volume tempest-invalid-203815724 could not be found. Jun 29 08:13:28.677138 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: action_args: {'id': 'tempest-invalid-203815724'} Jun 29 08:13:28.677138 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 08:13:28.678138 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:13:28.678138 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 29 08:13:28.678138 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 29 08:13:28.678138 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 29 08:13:28.678138 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 29 08:13:28.678138 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 29 08:13:28.678138 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 29 08:13:28.678138 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 29 08:13:28.678138 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 29 08:13:28.678138 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 29 08:13:28.678138 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 29 08:13:28.678138 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 29 08:13:28.678138 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 29 08:13:28.678138 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 29 08:13:28.678138 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 29 08:13:28.678138 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-203815724 could not be found. (HTTP 404) (Request-ID: req-7da9515e-0dec-43c5-843f-11b9508f9374) Jun 29 08:13:28.678138 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 29 08:13:28.678138 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 08:13:28.678138 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 29 08:13:28.679597 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:13:28.679597 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 29 08:13:28.679597 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 29 08:13:28.679597 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 29 08:13:28.679597 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 29 08:13:28.679597 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 29 08:13:28.679597 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 29 08:13:28.679597 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 29 08:13:28.679597 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 29 08:13:28.679597 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 29 08:13:28.679597 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 29 08:13:28.679597 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 29 08:13:28.679597 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 29 08:13:28.679597 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 29 08:13:28.679597 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 29 08:13:28.679597 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 29 08:13:28.679597 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 29 08:13:28.679597 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 29 08:13:28.679597 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 29 08:13:28.680778 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 29 08:13:28.680778 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 29 08:13:28.680778 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 29 08:13:28.680778 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 29 08:13:28.680778 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-203815724 could not be found. Jun 29 08:13:28.680778 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 29 08:13:28.680778 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 08:13:28.680778 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 29 08:13:28.680778 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:13:28.680778 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 08:13:28.680778 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 08:13:28.680778 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 08:13:28.680778 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 08:13:28.680778 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 29 08:13:28.680778 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 29 08:13:28.680778 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 08:13:28.680778 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 08:13:28.680778 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 29 08:13:28.680778 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 29 08:13:28.680778 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-203815724 could not be found. Jun 29 08:13:28.682082 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 29 08:13:28.682082 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 08:13:28.682082 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 29 08:13:28.682082 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:13:28.682082 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 08:13:28.682082 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 08:13:28.682082 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 08:13:28.682082 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 08:13:28.682082 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-203815724 could not be found. Jun 29 08:13:28.682082 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 29 08:13:28.682082 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-1dd9bb3b-5865-4047-9506-fc92715ff10f tempest-VolumesNegativeTest-730954138 tempest-VolumesNegativeTest-730954138-project] Returning 404 to user: Volume tempest-invalid-203815724 could not be found. {{(pid=117890) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 08:13:28.682082 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-1dd9bb3b-5865-4047-9506-fc92715ff10f tempest-VolumesNegativeTest-730954138 tempest-VolumesNegativeTest-730954138-project] 10.222.0.43 "DELETE /compute/v2.1/os-volumes/tempest-invalid-203815724" status: 404 len: 98 microversion: 2.1 time: 0.040085 Jun 29 08:13:28.682082 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 483/974] 10.222.0.43 () {58 vars in 1214 bytes} [Wed Jun 29 08:13:28 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-203815724 => generated 98 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 29 08:13:28.689692 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-a15c7177-87cf-444e-bfa8-aa9f94ac56c6 tempest-VolumesNegativeTest-730954138 tempest-VolumesNegativeTest-730954138-project] 10.222.0.43 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004941 Jun 29 08:13:28.690211 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 492/975] 10.222.0.43 () {58 vars in 1139 bytes} [Wed Jun 29 08:13:28 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jun 29 08:13:28.700069 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-940c48ff-a179-44ee-b504-5c3457330c79 tempest-VolumesNegativeTest-730954138 tempest-VolumesNegativeTest-730954138-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003896 Jun 29 08:13:28.700561 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 484/976] 10.222.0.43 () {58 vars in 1136 bytes} [Wed Jun 29 08:13:28 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jun 29 08:13:28.709676 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-179010af-3f0c-43fe-a481-98c3a42fb7c2 tempest-VolumesNegativeTest-730954138 tempest-VolumesNegativeTest-730954138-project] Calling method '.version_select at 0x7f724129bee0>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:13:28.738918 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.wsgi [None req-179010af-3f0c-43fe-a481-98c3a42fb7c2 tempest-VolumesNegativeTest-730954138 tempest-VolumesNegativeTest-730954138-project] HTTP exception thrown: Volume 69a7c588-a1b0-4950-bc5b-3186779f13f2 could not be found. Jun 29 08:13:28.740939 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-179010af-3f0c-43fe-a481-98c3a42fb7c2 tempest-VolumesNegativeTest-730954138 tempest-VolumesNegativeTest-730954138-project] Request method failure captured: Jun 29 08:13:28.740939 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: request: DELETE /compute/v2.1/os-volumes/69a7c588-a1b0-4950-bc5b-3186779f13f2 HTTP/1.1 Jun 29 08:13:28.740939 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: Accept: application/json Jun 29 08:13:28.740939 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: Accept-Encoding: identity Jun 29 08:13:28.740939 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: Connection: close Jun 29 08:13:28.740939 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: Content-Length: 0 Jun 29 08:13:28.740939 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: Content-Type: application/json Jun 29 08:13:28.740939 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: Host: 10.222.0.43 Jun 29 08:13:28.740939 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: Openstack-System-Scope: None Jun 29 08:13:28.740939 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: User-Agent: python-urllib3/1.26.9 Jun 29 08:13:28.740939 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Auth-Token: gAAAAABivAmorsOfMRGLnvnVOkJhkfyWLhLWTUCNBa0PrZ1bt4Wr7rnXRwkkgM8rwG2jbiZ0PwRSdwiHUJFNPIFGHOM9BqSwoAvTkvgqL5ROnaCRBVNpxcv1IvmZna0IMLAM5ZK-e4AGYyZLv8K5DfDN-jclPfqg9hSKxGb10fsca4F9ghEuXsg Jun 29 08:13:28.740939 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Domain-Id: None Jun 29 08:13:28.740939 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Domain-Name: None Jun 29 08:13:28.740939 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Identity-Status: Confirmed Jun 29 08:13:28.740939 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Is-Admin-Project: True Jun 29 08:13:28.740939 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Project-Domain-Id: default Jun 29 08:13:28.740939 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Project-Domain-Name: Default Jun 29 08:13:28.740939 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Project-Id: c2499d2faee84edda5f26ec0d21aecbb Jun 29 08:13:28.740939 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Project-Name: tempest-VolumesNegativeTest-730954138 Jun 29 08:13:28.740939 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Role: member,reader Jun 29 08:13:28.740939 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Roles: member,reader Jun 29 08:13:28.743449 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/c2499d2faee84edda5f26ec0d21aecbb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_c2499d2faee84edda5f26ec0d21aecbb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/c2499d2faee84edda5f26ec0d21aecbb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/c2499d2faee84edda5f26ec0d21aecbb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Jun 29 08:13:28.743449 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Tenant: tempest-VolumesNegativeTest-730954138 Jun 29 08:13:28.743449 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Tenant-Id: c2499d2faee84edda5f26ec0d21aecbb Jun 29 08:13:28.743449 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Tenant-Name: tempest-VolumesNegativeTest-730954138 Jun 29 08:13:28.743449 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-User: tempest-VolumesNegativeTest-730954138-project Jun 29 08:13:28.743449 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-User-Domain-Id: default Jun 29 08:13:28.743449 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-User-Domain-Name: Default Jun 29 08:13:28.743449 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-User-Id: 8f84036eb86b4907a20d46978920eadd Jun 29 08:13:28.743449 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-User-Name: tempest-VolumesNegativeTest-730954138-project Jun 29 08:13:28.743449 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: method: Jun 29 08:13:28.743449 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: exception: Volume 69a7c588-a1b0-4950-bc5b-3186779f13f2 could not be found. Jun 29 08:13:28.743449 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: action_args: {'id': '69a7c588-a1b0-4950-bc5b-3186779f13f2'} Jun 29 08:13:28.743449 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 08:13:28.744489 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:13:28.744489 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 29 08:13:28.744489 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 29 08:13:28.744489 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 29 08:13:28.744489 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 29 08:13:28.744489 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 29 08:13:28.744489 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 29 08:13:28.744489 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 29 08:13:28.744489 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 29 08:13:28.744489 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 29 08:13:28.744489 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 29 08:13:28.744489 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 29 08:13:28.744489 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 29 08:13:28.744489 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 29 08:13:28.744489 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 29 08:13:28.744489 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 69a7c588-a1b0-4950-bc5b-3186779f13f2 could not be found. (HTTP 404) (Request-ID: req-119527d0-5267-49c4-af18-cdc4075d285e) Jun 29 08:13:28.744489 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 29 08:13:28.744489 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 08:13:28.744489 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 29 08:13:28.746246 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:13:28.746246 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 29 08:13:28.746246 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 29 08:13:28.746246 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 29 08:13:28.746246 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 29 08:13:28.746246 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 29 08:13:28.746246 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 29 08:13:28.746246 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 29 08:13:28.746246 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 29 08:13:28.746246 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 29 08:13:28.746246 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 29 08:13:28.746246 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 29 08:13:28.746246 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 29 08:13:28.746246 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 29 08:13:28.746246 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 29 08:13:28.746246 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 29 08:13:28.746246 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 29 08:13:28.746246 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 29 08:13:28.746246 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 29 08:13:28.747677 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 29 08:13:28.747677 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 29 08:13:28.747677 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 29 08:13:28.747677 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 29 08:13:28.747677 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 69a7c588-a1b0-4950-bc5b-3186779f13f2 could not be found. Jun 29 08:13:28.747677 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 29 08:13:28.747677 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 08:13:28.747677 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 29 08:13:28.747677 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:13:28.747677 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 08:13:28.747677 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 08:13:28.747677 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 08:13:28.747677 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 08:13:28.747677 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 29 08:13:28.747677 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 29 08:13:28.747677 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 08:13:28.747677 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 08:13:28.747677 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 29 08:13:28.747677 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 29 08:13:28.749284 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 69a7c588-a1b0-4950-bc5b-3186779f13f2 could not be found. Jun 29 08:13:28.749284 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 29 08:13:28.749284 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 08:13:28.749284 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 29 08:13:28.749284 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:13:28.749284 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 08:13:28.749284 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 08:13:28.749284 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 08:13:28.749284 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 08:13:28.749284 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 69a7c588-a1b0-4950-bc5b-3186779f13f2 could not be found. Jun 29 08:13:28.749284 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 29 08:13:28.749284 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-179010af-3f0c-43fe-a481-98c3a42fb7c2 tempest-VolumesNegativeTest-730954138 tempest-VolumesNegativeTest-730954138-project] Returning 404 to user: Volume 69a7c588-a1b0-4950-bc5b-3186779f13f2 could not be found. {{(pid=117889) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 08:13:28.749284 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-179010af-3f0c-43fe-a481-98c3a42fb7c2 tempest-VolumesNegativeTest-730954138 tempest-VolumesNegativeTest-730954138-project] 10.222.0.43 "DELETE /compute/v2.1/os-volumes/69a7c588-a1b0-4950-bc5b-3186779f13f2" status: 404 len: 109 microversion: 2.1 time: 0.036848 Jun 29 08:13:28.749284 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 493/977] 10.222.0.43 () {58 vars in 1247 bytes} [Wed Jun 29 08:13:28 2022] DELETE /compute/v2.1/os-volumes/69a7c588-a1b0-4950-bc5b-3186779f13f2 => generated 109 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 29 08:13:28.759515 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-3343f19e-6993-4d80-9960-3e8cf10d8e8c tempest-VolumesNegativeTest-730954138 tempest-VolumesNegativeTest-730954138-project] Calling method '.version_select at 0x7f724166ba60>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:13:28.792584 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.wsgi [None req-3343f19e-6993-4d80-9960-3e8cf10d8e8c tempest-VolumesNegativeTest-730954138 tempest-VolumesNegativeTest-730954138-project] HTTP exception thrown: Volume 01c613b9-7fbf-4308-bcaa-67627f0f3cd8 could not be found. Jun 29 08:13:28.794628 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-3343f19e-6993-4d80-9960-3e8cf10d8e8c tempest-VolumesNegativeTest-730954138 tempest-VolumesNegativeTest-730954138-project] Request method failure captured: Jun 29 08:13:28.794628 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: request: GET /compute/v2.1/os-volumes/01c613b9-7fbf-4308-bcaa-67627f0f3cd8 HTTP/1.1 Jun 29 08:13:28.794628 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: Accept: application/json Jun 29 08:13:28.794628 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: Accept-Encoding: identity Jun 29 08:13:28.794628 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: Connection: close Jun 29 08:13:28.794628 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: Content-Length: 0 Jun 29 08:13:28.794628 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: Content-Type: application/json Jun 29 08:13:28.794628 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: Host: 10.222.0.43 Jun 29 08:13:28.794628 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: Openstack-System-Scope: None Jun 29 08:13:28.794628 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: User-Agent: python-urllib3/1.26.9 Jun 29 08:13:28.794628 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Auth-Token: gAAAAABivAmorsOfMRGLnvnVOkJhkfyWLhLWTUCNBa0PrZ1bt4Wr7rnXRwkkgM8rwG2jbiZ0PwRSdwiHUJFNPIFGHOM9BqSwoAvTkvgqL5ROnaCRBVNpxcv1IvmZna0IMLAM5ZK-e4AGYyZLv8K5DfDN-jclPfqg9hSKxGb10fsca4F9ghEuXsg Jun 29 08:13:28.794628 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Domain-Id: None Jun 29 08:13:28.794628 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Domain-Name: None Jun 29 08:13:28.794628 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Identity-Status: Confirmed Jun 29 08:13:28.794628 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Is-Admin-Project: True Jun 29 08:13:28.794628 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Project-Domain-Id: default Jun 29 08:13:28.794628 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Project-Domain-Name: Default Jun 29 08:13:28.794628 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Project-Id: c2499d2faee84edda5f26ec0d21aecbb Jun 29 08:13:28.794628 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Project-Name: tempest-VolumesNegativeTest-730954138 Jun 29 08:13:28.794628 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Role: member,reader Jun 29 08:13:28.794628 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Roles: member,reader Jun 29 08:13:28.796885 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/c2499d2faee84edda5f26ec0d21aecbb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_c2499d2faee84edda5f26ec0d21aecbb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/c2499d2faee84edda5f26ec0d21aecbb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/c2499d2faee84edda5f26ec0d21aecbb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Jun 29 08:13:28.796885 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Tenant: tempest-VolumesNegativeTest-730954138 Jun 29 08:13:28.796885 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Tenant-Id: c2499d2faee84edda5f26ec0d21aecbb Jun 29 08:13:28.796885 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Tenant-Name: tempest-VolumesNegativeTest-730954138 Jun 29 08:13:28.796885 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-User: tempest-VolumesNegativeTest-730954138-project Jun 29 08:13:28.796885 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-User-Domain-Id: default Jun 29 08:13:28.796885 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-User-Domain-Name: Default Jun 29 08:13:28.796885 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-User-Id: 8f84036eb86b4907a20d46978920eadd Jun 29 08:13:28.796885 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-User-Name: tempest-VolumesNegativeTest-730954138-project Jun 29 08:13:28.796885 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: method: Jun 29 08:13:28.796885 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: exception: Volume 01c613b9-7fbf-4308-bcaa-67627f0f3cd8 could not be found. Jun 29 08:13:28.796885 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: action_args: {'id': '01c613b9-7fbf-4308-bcaa-67627f0f3cd8'} Jun 29 08:13:28.796885 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 08:13:28.798553 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:13:28.798553 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 29 08:13:28.798553 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 29 08:13:28.798553 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 29 08:13:28.798553 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 29 08:13:28.798553 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 29 08:13:28.798553 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 29 08:13:28.798553 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 29 08:13:28.798553 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 29 08:13:28.798553 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 29 08:13:28.798553 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 29 08:13:28.798553 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 29 08:13:28.798553 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 29 08:13:28.798553 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 29 08:13:28.798553 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 29 08:13:28.798553 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 01c613b9-7fbf-4308-bcaa-67627f0f3cd8 could not be found. (HTTP 404) (Request-ID: req-a187875f-bda1-469b-bf88-5d933acfcf50) Jun 29 08:13:28.798553 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 29 08:13:28.798553 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 08:13:28.798553 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 29 08:13:28.800796 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:13:28.800796 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 29 08:13:28.800796 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 29 08:13:28.800796 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 29 08:13:28.800796 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 29 08:13:28.800796 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 29 08:13:28.800796 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 29 08:13:28.800796 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 29 08:13:28.800796 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 29 08:13:28.800796 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 29 08:13:28.800796 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 29 08:13:28.800796 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 29 08:13:28.800796 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 29 08:13:28.800796 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 29 08:13:28.800796 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 29 08:13:28.800796 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 29 08:13:28.800796 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 29 08:13:28.800796 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 29 08:13:28.800796 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 29 08:13:28.803130 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 29 08:13:28.803130 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 29 08:13:28.803130 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 29 08:13:28.803130 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 29 08:13:28.803130 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 01c613b9-7fbf-4308-bcaa-67627f0f3cd8 could not be found. Jun 29 08:13:28.803130 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 29 08:13:28.803130 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 08:13:28.803130 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 29 08:13:28.803130 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:13:28.803130 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 08:13:28.803130 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 08:13:28.803130 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 08:13:28.803130 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 08:13:28.803130 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 29 08:13:28.803130 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 29 08:13:28.803130 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 08:13:28.803130 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 08:13:28.803130 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 29 08:13:28.803130 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 29 08:13:28.805455 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 01c613b9-7fbf-4308-bcaa-67627f0f3cd8 could not be found. Jun 29 08:13:28.805455 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 29 08:13:28.805455 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 08:13:28.805455 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 29 08:13:28.805455 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:13:28.805455 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 08:13:28.805455 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 08:13:28.805455 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 08:13:28.805455 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 08:13:28.805455 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 01c613b9-7fbf-4308-bcaa-67627f0f3cd8 could not be found. Jun 29 08:13:28.805455 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 29 08:13:28.805455 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-3343f19e-6993-4d80-9960-3e8cf10d8e8c tempest-VolumesNegativeTest-730954138 tempest-VolumesNegativeTest-730954138-project] Returning 404 to user: Volume 01c613b9-7fbf-4308-bcaa-67627f0f3cd8 could not be found. {{(pid=117890) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 08:13:28.805455 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-3343f19e-6993-4d80-9960-3e8cf10d8e8c tempest-VolumesNegativeTest-730954138 tempest-VolumesNegativeTest-730954138-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/01c613b9-7fbf-4308-bcaa-67627f0f3cd8" status: 404 len: 109 microversion: 2.1 time: 0.044331 Jun 29 08:13:28.805455 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 485/978] 10.222.0.43 () {58 vars in 1244 bytes} [Wed Jun 29 08:13:28 2022] GET /compute/v2.1/os-volumes/01c613b9-7fbf-4308-bcaa-67627f0f3cd8 => generated 109 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 29 08:14:38.852776 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_api:SELECT=20 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:14:38.853588 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_cell1:SELECT=41,nova_cell1:INSERT=1 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:14:38.857973 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-b2667130-1a6e-4622-acc6-8f0581ac9eb6 tempest-VolumesNegativeTest-1506185721 tempest-VolumesNegativeTest-1506185721-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-2089499670", "imageRef": "5d2148a0-3628-4eff-88e9-5686abc0d33e", "flavorRef": "452"}} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:14:38.912822 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.network.neutron [None req-b2667130-1a6e-4622-acc6-8f0581ac9eb6 tempest-VolumesNegativeTest-1506185721 tempest-VolumesNegativeTest-1506185721-project] validate_networks() for None {{(pid=117889) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 29 08:14:39.213507 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.virt.hardware [None req-b2667130-1a6e-4622-acc6-8f0581ac9eb6 tempest-VolumesNegativeTest-1506185721 tempest-VolumesNegativeTest-1506185721-project] Flavor limits 0:0:0 {{(pid=117889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 29 08:14:39.213933 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.virt.hardware [None req-b2667130-1a6e-4622-acc6-8f0581ac9eb6 tempest-VolumesNegativeTest-1506185721 tempest-VolumesNegativeTest-1506185721-project] Image limits 0:0:0 {{(pid=117889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 29 08:14:39.214386 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.virt.hardware [None req-b2667130-1a6e-4622-acc6-8f0581ac9eb6 tempest-VolumesNegativeTest-1506185721 tempest-VolumesNegativeTest-1506185721-project] Flavor pref 0:0:0 {{(pid=117889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 29 08:14:39.214794 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.virt.hardware [None req-b2667130-1a6e-4622-acc6-8f0581ac9eb6 tempest-VolumesNegativeTest-1506185721 tempest-VolumesNegativeTest-1506185721-project] Image pref 0:0:0 {{(pid=117889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 29 08:14:39.215204 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.virt.hardware [None req-b2667130-1a6e-4622-acc6-8f0581ac9eb6 tempest-VolumesNegativeTest-1506185721 tempest-VolumesNegativeTest-1506185721-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 29 08:14:39.224600 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-b2667130-1a6e-4622-acc6-8f0581ac9eb6 tempest-VolumesNegativeTest-1506185721 tempest-VolumesNegativeTest-1506185721-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:14:39.225078 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-b2667130-1a6e-4622-acc6-8f0581ac9eb6 tempest-VolumesNegativeTest-1506185721 tempest-VolumesNegativeTest-1506185721-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:14:39.225874 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-b2667130-1a6e-4622-acc6-8f0581ac9eb6 tempest-VolumesNegativeTest-1506185721 tempest-VolumesNegativeTest-1506185721-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:14:39.226306 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-b2667130-1a6e-4622-acc6-8f0581ac9eb6 tempest-VolumesNegativeTest-1506185721 tempest-VolumesNegativeTest-1506185721-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:14:39.243517 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.quota [None req-b2667130-1a6e-4622-acc6-8f0581ac9eb6 tempest-VolumesNegativeTest-1506185721 tempest-VolumesNegativeTest-1506185721-project] Getting quotas for project 74c7b1ba386348c0b22d4cc4bf296735. Resources: {'ram', 'instances', 'cores'} {{(pid=117889) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 29 08:14:39.247390 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.quota [None req-b2667130-1a6e-4622-acc6-8f0581ac9eb6 tempest-VolumesNegativeTest-1506185721 tempest-VolumesNegativeTest-1506185721-project] Getting quotas for user 0bf77869a8f84d9ca61053e6a0fc08d9 and project 74c7b1ba386348c0b22d4cc4bf296735. Resources: {'ram', 'instances', 'cores'} {{(pid=117889) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 29 08:14:39.258698 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-b2667130-1a6e-4622-acc6-8f0581ac9eb6 tempest-VolumesNegativeTest-1506185721 tempest-VolumesNegativeTest-1506185721-project] Going to run 1 instances... {{(pid=117889) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 29 08:14:39.260931 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-b2667130-1a6e-4622-acc6-8f0581ac9eb6 tempest-VolumesNegativeTest-1506185721 tempest-VolumesNegativeTest-1506185721-project] [instance: b035abda-fdd9-49ac-9f24-2e72cefc1b94] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5d2148a0-3628-4eff-88e9-5686abc0d33e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117889) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 29 08:14:39.309995 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-b2667130-1a6e-4622-acc6-8f0581ac9eb6 tempest-VolumesNegativeTest-1506185721 tempest-VolumesNegativeTest-1506185721-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.458943 Jun 29 08:14:39.316457 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 494/979] 10.222.0.43 () {60 vars in 1146 bytes} [Wed Jun 29 08:14:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 461 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 29 08:14:39.319953 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG dbcounter [-] [117890] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:14:39.320752 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG dbcounter [-] [117890] Writing DB stats nova_cell1:SELECT=47,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:14:39.325779 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-7e703c1b-a279-4512-ab23-53ae666c0211 tempest-VolumesNegativeTest-1506185721 tempest-VolumesNegativeTest-1506185721-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:14:39.326405 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-7e703c1b-a279-4512-ab23-53ae666c0211 tempest-VolumesNegativeTest-1506185721 tempest-VolumesNegativeTest-1506185721-project] [instance: b035abda-fdd9-49ac-9f24-2e72cefc1b94] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:14:39.387359 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-7e703c1b-a279-4512-ab23-53ae666c0211 tempest-VolumesNegativeTest-1506185721 tempest-VolumesNegativeTest-1506185721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bf77869a8f84d9ca61053e6a0fc08d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74c7b1ba386348c0b22d4cc4bf296735', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:14:39.395325 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-7e703c1b-a279-4512-ab23-53ae666c0211 tempest-VolumesNegativeTest-1506185721 tempest-VolumesNegativeTest-1506185721-project] 10.222.0.43 "GET /compute/v2.1/servers/b035abda-fdd9-49ac-9f24-2e72cefc1b94" status: 200 len: 1215 microversion: 2.1 time: 0.077289 Jun 29 08:14:39.395889 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 486/980] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:14:39 2022] GET /compute/v2.1/servers/b035abda-fdd9-49ac-9f24-2e72cefc1b94 => generated 1215 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:14:40.413266 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-70553911-bbde-45b3-a8e9-80d6cc949efe tempest-VolumesNegativeTest-1506185721 tempest-VolumesNegativeTest-1506185721-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:14:40.413882 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-70553911-bbde-45b3-a8e9-80d6cc949efe tempest-VolumesNegativeTest-1506185721 tempest-VolumesNegativeTest-1506185721-project] [instance: b035abda-fdd9-49ac-9f24-2e72cefc1b94] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:14:40.421513 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-70553911-bbde-45b3-a8e9-80d6cc949efe tempest-VolumesNegativeTest-1506185721 tempest-VolumesNegativeTest-1506185721-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:14:40.422024 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-70553911-bbde-45b3-a8e9-80d6cc949efe tempest-VolumesNegativeTest-1506185721 tempest-VolumesNegativeTest-1506185721-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:14:40.422972 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-70553911-bbde-45b3-a8e9-80d6cc949efe tempest-VolumesNegativeTest-1506185721 tempest-VolumesNegativeTest-1506185721-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:14:40.423498 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-70553911-bbde-45b3-a8e9-80d6cc949efe tempest-VolumesNegativeTest-1506185721 tempest-VolumesNegativeTest-1506185721-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:14:40.504381 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-70553911-bbde-45b3-a8e9-80d6cc949efe tempest-VolumesNegativeTest-1506185721 tempest-VolumesNegativeTest-1506185721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bf77869a8f84d9ca61053e6a0fc08d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74c7b1ba386348c0b22d4cc4bf296735', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:14:40.512579 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-70553911-bbde-45b3-a8e9-80d6cc949efe tempest-VolumesNegativeTest-1506185721 tempest-VolumesNegativeTest-1506185721-project] 10.222.0.43 "GET /compute/v2.1/servers/b035abda-fdd9-49ac-9f24-2e72cefc1b94" status: 200 len: 1285 microversion: 2.1 time: 0.104773 Jun 29 08:14:40.513434 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 495/981] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:14:40 2022] GET /compute/v2.1/servers/b035abda-fdd9-49ac-9f24-2e72cefc1b94 => generated 1285 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:14:41.529502 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-f4369b42-6486-4eb1-8f7a-43395d59d1cd tempest-VolumesNegativeTest-1506185721 tempest-VolumesNegativeTest-1506185721-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:14:41.530324 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-f4369b42-6486-4eb1-8f7a-43395d59d1cd tempest-VolumesNegativeTest-1506185721 tempest-VolumesNegativeTest-1506185721-project] [instance: b035abda-fdd9-49ac-9f24-2e72cefc1b94] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:14:41.537628 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-f4369b42-6486-4eb1-8f7a-43395d59d1cd tempest-VolumesNegativeTest-1506185721 tempest-VolumesNegativeTest-1506185721-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:14:41.538077 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-f4369b42-6486-4eb1-8f7a-43395d59d1cd tempest-VolumesNegativeTest-1506185721 tempest-VolumesNegativeTest-1506185721-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:14:41.539080 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-f4369b42-6486-4eb1-8f7a-43395d59d1cd tempest-VolumesNegativeTest-1506185721 tempest-VolumesNegativeTest-1506185721-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:14:41.539682 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-f4369b42-6486-4eb1-8f7a-43395d59d1cd tempest-VolumesNegativeTest-1506185721 tempest-VolumesNegativeTest-1506185721-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:14:41.698364 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-f4369b42-6486-4eb1-8f7a-43395d59d1cd tempest-VolumesNegativeTest-1506185721 tempest-VolumesNegativeTest-1506185721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bf77869a8f84d9ca61053e6a0fc08d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74c7b1ba386348c0b22d4cc4bf296735', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:14:41.705977 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-f4369b42-6486-4eb1-8f7a-43395d59d1cd tempest-VolumesNegativeTest-1506185721 tempest-VolumesNegativeTest-1506185721-project] 10.222.0.43 "GET /compute/v2.1/servers/b035abda-fdd9-49ac-9f24-2e72cefc1b94" status: 200 len: 1315 microversion: 2.1 time: 0.180436 Jun 29 08:14:41.706613 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 487/982] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:14:41 2022] GET /compute/v2.1/servers/b035abda-fdd9-49ac-9f24-2e72cefc1b94 => generated 1315 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:14:42.530059 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [req-fc6db531-a3b1-4e2a-a0a1-599ebd409277 req-6830ca9c-4fa3-4847-bef4-93287f40829c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b035abda-fdd9-49ac-9f24-2e72cefc1b94", "tag": "4b5a4551-bf64-49bb-8c65-9dfc1ef531e8"}]} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:14:42.541376 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-fc6db531-a3b1-4e2a-a0a1-599ebd409277 req-6830ca9c-4fa3-4847-bef4-93287f40829c service nova] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:14:42.541753 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-fc6db531-a3b1-4e2a-a0a1-599ebd409277 req-6830ca9c-4fa3-4847-bef4-93287f40829c service nova] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:14:42.554479 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.compute.server_external_events [req-fc6db531-a3b1-4e2a-a0a1-599ebd409277 req-6830ca9c-4fa3-4847-bef4-93287f40829c service nova] Creating event network-changed:4b5a4551-bf64-49bb-8c65-9dfc1ef531e8 for instance b035abda-fdd9-49ac-9f24-2e72cefc1b94 on hv-cinder-76810 Jun 29 08:14:42.560444 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [req-fc6db531-a3b1-4e2a-a0a1-599ebd409277 req-6830ca9c-4fa3-4847-bef4-93287f40829c service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.213789 Jun 29 08:14:42.561067 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 496/983] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jun 29 08:14:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:14:42.723653 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-572659c2-ebbb-4cbe-b8cd-51decddde6e8 tempest-VolumesNegativeTest-1506185721 tempest-VolumesNegativeTest-1506185721-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:14:42.724318 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-572659c2-ebbb-4cbe-b8cd-51decddde6e8 tempest-VolumesNegativeTest-1506185721 tempest-VolumesNegativeTest-1506185721-project] [instance: b035abda-fdd9-49ac-9f24-2e72cefc1b94] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:14:42.732116 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-572659c2-ebbb-4cbe-b8cd-51decddde6e8 tempest-VolumesNegativeTest-1506185721 tempest-VolumesNegativeTest-1506185721-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:14:42.732596 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-572659c2-ebbb-4cbe-b8cd-51decddde6e8 tempest-VolumesNegativeTest-1506185721 tempest-VolumesNegativeTest-1506185721-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:14:42.733359 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-572659c2-ebbb-4cbe-b8cd-51decddde6e8 tempest-VolumesNegativeTest-1506185721 tempest-VolumesNegativeTest-1506185721-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:14:42.733799 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-572659c2-ebbb-4cbe-b8cd-51decddde6e8 tempest-VolumesNegativeTest-1506185721 tempest-VolumesNegativeTest-1506185721-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:14:42.943717 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-572659c2-ebbb-4cbe-b8cd-51decddde6e8 tempest-VolumesNegativeTest-1506185721 tempest-VolumesNegativeTest-1506185721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bf77869a8f84d9ca61053e6a0fc08d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74c7b1ba386348c0b22d4cc4bf296735', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:14:42.951801 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-572659c2-ebbb-4cbe-b8cd-51decddde6e8 tempest-VolumesNegativeTest-1506185721 tempest-VolumesNegativeTest-1506185721-project] 10.222.0.43 "GET /compute/v2.1/servers/b035abda-fdd9-49ac-9f24-2e72cefc1b94" status: 200 len: 1315 microversion: 2.1 time: 0.231943 Jun 29 08:14:42.952826 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 488/984] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:14:42 2022] GET /compute/v2.1/servers/b035abda-fdd9-49ac-9f24-2e72cefc1b94 => generated 1315 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:14:43.971075 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-44b6a452-9b7c-405c-85f6-d49730a19581 tempest-VolumesNegativeTest-1506185721 tempest-VolumesNegativeTest-1506185721-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:14:43.971774 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-44b6a452-9b7c-405c-85f6-d49730a19581 tempest-VolumesNegativeTest-1506185721 tempest-VolumesNegativeTest-1506185721-project] [instance: b035abda-fdd9-49ac-9f24-2e72cefc1b94] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:14:43.978808 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-44b6a452-9b7c-405c-85f6-d49730a19581 tempest-VolumesNegativeTest-1506185721 tempest-VolumesNegativeTest-1506185721-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:14:43.979253 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-44b6a452-9b7c-405c-85f6-d49730a19581 tempest-VolumesNegativeTest-1506185721 tempest-VolumesNegativeTest-1506185721-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:14:43.980025 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-44b6a452-9b7c-405c-85f6-d49730a19581 tempest-VolumesNegativeTest-1506185721 tempest-VolumesNegativeTest-1506185721-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:14:43.980476 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-44b6a452-9b7c-405c-85f6-d49730a19581 tempest-VolumesNegativeTest-1506185721 tempest-VolumesNegativeTest-1506185721-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:14:44.115994 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-44b6a452-9b7c-405c-85f6-d49730a19581 tempest-VolumesNegativeTest-1506185721 tempest-VolumesNegativeTest-1506185721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bf77869a8f84d9ca61053e6a0fc08d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74c7b1ba386348c0b22d4cc4bf296735', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:14:44.123678 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-44b6a452-9b7c-405c-85f6-d49730a19581 tempest-VolumesNegativeTest-1506185721 tempest-VolumesNegativeTest-1506185721-project] 10.222.0.43 "GET /compute/v2.1/servers/b035abda-fdd9-49ac-9f24-2e72cefc1b94" status: 200 len: 1315 microversion: 2.1 time: 0.157053 Jun 29 08:14:44.124246 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 497/985] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:14:43 2022] GET /compute/v2.1/servers/b035abda-fdd9-49ac-9f24-2e72cefc1b94 => generated 1315 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:14:45.140263 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-30f26ec6-02e1-4389-82ab-fc89f525258b tempest-VolumesNegativeTest-1506185721 tempest-VolumesNegativeTest-1506185721-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:14:45.140866 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-30f26ec6-02e1-4389-82ab-fc89f525258b tempest-VolumesNegativeTest-1506185721 tempest-VolumesNegativeTest-1506185721-project] [instance: b035abda-fdd9-49ac-9f24-2e72cefc1b94] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:14:45.148021 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-30f26ec6-02e1-4389-82ab-fc89f525258b tempest-VolumesNegativeTest-1506185721 tempest-VolumesNegativeTest-1506185721-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:14:45.148481 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-30f26ec6-02e1-4389-82ab-fc89f525258b tempest-VolumesNegativeTest-1506185721 tempest-VolumesNegativeTest-1506185721-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:14:45.149285 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-30f26ec6-02e1-4389-82ab-fc89f525258b tempest-VolumesNegativeTest-1506185721 tempest-VolumesNegativeTest-1506185721-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:14:45.149725 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-30f26ec6-02e1-4389-82ab-fc89f525258b tempest-VolumesNegativeTest-1506185721 tempest-VolumesNegativeTest-1506185721-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:14:45.282894 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-30f26ec6-02e1-4389-82ab-fc89f525258b tempest-VolumesNegativeTest-1506185721 tempest-VolumesNegativeTest-1506185721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bf77869a8f84d9ca61053e6a0fc08d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74c7b1ba386348c0b22d4cc4bf296735', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:14:45.290424 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-30f26ec6-02e1-4389-82ab-fc89f525258b tempest-VolumesNegativeTest-1506185721 tempest-VolumesNegativeTest-1506185721-project] 10.222.0.43 "GET /compute/v2.1/servers/b035abda-fdd9-49ac-9f24-2e72cefc1b94" status: 200 len: 1315 microversion: 2.1 time: 0.154045 Jun 29 08:14:45.290976 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 489/986] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:14:45 2022] GET /compute/v2.1/servers/b035abda-fdd9-49ac-9f24-2e72cefc1b94 => generated 1315 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:14:46.307615 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-2570e123-4066-4bc1-898c-0884cf9c393d tempest-VolumesNegativeTest-1506185721 tempest-VolumesNegativeTest-1506185721-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:14:46.308236 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-2570e123-4066-4bc1-898c-0884cf9c393d tempest-VolumesNegativeTest-1506185721 tempest-VolumesNegativeTest-1506185721-project] [instance: b035abda-fdd9-49ac-9f24-2e72cefc1b94] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:14:46.315033 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-2570e123-4066-4bc1-898c-0884cf9c393d tempest-VolumesNegativeTest-1506185721 tempest-VolumesNegativeTest-1506185721-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:14:46.315509 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-2570e123-4066-4bc1-898c-0884cf9c393d tempest-VolumesNegativeTest-1506185721 tempest-VolumesNegativeTest-1506185721-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:14:46.317367 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-2570e123-4066-4bc1-898c-0884cf9c393d tempest-VolumesNegativeTest-1506185721 tempest-VolumesNegativeTest-1506185721-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:14:46.317819 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-2570e123-4066-4bc1-898c-0884cf9c393d tempest-VolumesNegativeTest-1506185721 tempest-VolumesNegativeTest-1506185721-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:14:46.450101 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-2570e123-4066-4bc1-898c-0884cf9c393d tempest-VolumesNegativeTest-1506185721 tempest-VolumesNegativeTest-1506185721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bf77869a8f84d9ca61053e6a0fc08d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74c7b1ba386348c0b22d4cc4bf296735', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:14:46.458226 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-2570e123-4066-4bc1-898c-0884cf9c393d tempest-VolumesNegativeTest-1506185721 tempest-VolumesNegativeTest-1506185721-project] 10.222.0.43 "GET /compute/v2.1/servers/b035abda-fdd9-49ac-9f24-2e72cefc1b94" status: 200 len: 1315 microversion: 2.1 time: 0.154545 Jun 29 08:14:46.458788 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 498/987] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:14:46 2022] GET /compute/v2.1/servers/b035abda-fdd9-49ac-9f24-2e72cefc1b94 => generated 1315 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:14:47.475645 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-5a985e76-4d1a-464d-b6da-11d4d22d5b0c tempest-VolumesNegativeTest-1506185721 tempest-VolumesNegativeTest-1506185721-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:14:47.476247 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-5a985e76-4d1a-464d-b6da-11d4d22d5b0c tempest-VolumesNegativeTest-1506185721 tempest-VolumesNegativeTest-1506185721-project] [instance: b035abda-fdd9-49ac-9f24-2e72cefc1b94] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:14:47.482824 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-5a985e76-4d1a-464d-b6da-11d4d22d5b0c tempest-VolumesNegativeTest-1506185721 tempest-VolumesNegativeTest-1506185721-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:14:47.483266 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-5a985e76-4d1a-464d-b6da-11d4d22d5b0c tempest-VolumesNegativeTest-1506185721 tempest-VolumesNegativeTest-1506185721-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:14:47.484032 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-5a985e76-4d1a-464d-b6da-11d4d22d5b0c tempest-VolumesNegativeTest-1506185721 tempest-VolumesNegativeTest-1506185721-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:14:47.484466 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-5a985e76-4d1a-464d-b6da-11d4d22d5b0c tempest-VolumesNegativeTest-1506185721 tempest-VolumesNegativeTest-1506185721-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:14:47.621447 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-5a985e76-4d1a-464d-b6da-11d4d22d5b0c tempest-VolumesNegativeTest-1506185721 tempest-VolumesNegativeTest-1506185721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bf77869a8f84d9ca61053e6a0fc08d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74c7b1ba386348c0b22d4cc4bf296735', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:14:47.628858 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-5a985e76-4d1a-464d-b6da-11d4d22d5b0c tempest-VolumesNegativeTest-1506185721 tempest-VolumesNegativeTest-1506185721-project] 10.222.0.43 "GET /compute/v2.1/servers/b035abda-fdd9-49ac-9f24-2e72cefc1b94" status: 200 len: 1315 microversion: 2.1 time: 0.157672 Jun 29 08:14:47.629454 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 490/988] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:14:47 2022] GET /compute/v2.1/servers/b035abda-fdd9-49ac-9f24-2e72cefc1b94 => generated 1315 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:14:47.961623 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [req-e238d2f2-5871-4b26-8855-020c3dd819ef req-ab91e5f7-d058-4e9f-a46a-199ab5ac206e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b035abda-fdd9-49ac-9f24-2e72cefc1b94", "name": "network-vif-plugged", "status": "completed", "tag": "4b5a4551-bf64-49bb-8c65-9dfc1ef531e8"}]} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:14:47.970661 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-e238d2f2-5871-4b26-8855-020c3dd819ef req-ab91e5f7-d058-4e9f-a46a-199ab5ac206e service nova] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:14:47.971262 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-e238d2f2-5871-4b26-8855-020c3dd819ef req-ab91e5f7-d058-4e9f-a46a-199ab5ac206e service nova] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:14:47.983798 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.compute.server_external_events [req-e238d2f2-5871-4b26-8855-020c3dd819ef req-ab91e5f7-d058-4e9f-a46a-199ab5ac206e service nova] Creating event network-vif-plugged:4b5a4551-bf64-49bb-8c65-9dfc1ef531e8 for instance b035abda-fdd9-49ac-9f24-2e72cefc1b94 on hv-cinder-76810 Jun 29 08:14:47.989661 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [req-e238d2f2-5871-4b26-8855-020c3dd819ef req-ab91e5f7-d058-4e9f-a46a-199ab5ac206e service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092745 Jun 29 08:14:47.990286 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 499/989] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jun 29 08:14:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 29 08:14:48.646152 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-13dc73ac-4704-4b99-a640-80310d76928c tempest-VolumesNegativeTest-1506185721 tempest-VolumesNegativeTest-1506185721-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:14:48.646794 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-13dc73ac-4704-4b99-a640-80310d76928c tempest-VolumesNegativeTest-1506185721 tempest-VolumesNegativeTest-1506185721-project] [instance: b035abda-fdd9-49ac-9f24-2e72cefc1b94] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:14:48.653313 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-13dc73ac-4704-4b99-a640-80310d76928c tempest-VolumesNegativeTest-1506185721 tempest-VolumesNegativeTest-1506185721-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:14:48.653764 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-13dc73ac-4704-4b99-a640-80310d76928c tempest-VolumesNegativeTest-1506185721 tempest-VolumesNegativeTest-1506185721-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:14:48.654532 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-13dc73ac-4704-4b99-a640-80310d76928c tempest-VolumesNegativeTest-1506185721 tempest-VolumesNegativeTest-1506185721-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:14:48.654968 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-13dc73ac-4704-4b99-a640-80310d76928c tempest-VolumesNegativeTest-1506185721 tempest-VolumesNegativeTest-1506185721-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:14:48.788243 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-13dc73ac-4704-4b99-a640-80310d76928c tempest-VolumesNegativeTest-1506185721 tempest-VolumesNegativeTest-1506185721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bf77869a8f84d9ca61053e6a0fc08d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74c7b1ba386348c0b22d4cc4bf296735', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:14:48.795767 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-13dc73ac-4704-4b99-a640-80310d76928c tempest-VolumesNegativeTest-1506185721 tempest-VolumesNegativeTest-1506185721-project] 10.222.0.43 "GET /compute/v2.1/servers/b035abda-fdd9-49ac-9f24-2e72cefc1b94" status: 200 len: 1315 microversion: 2.1 time: 0.154076 Jun 29 08:14:48.797059 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 491/990] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:14:48 2022] GET /compute/v2.1/servers/b035abda-fdd9-49ac-9f24-2e72cefc1b94 => generated 1315 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:14:49.814177 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-2fc84e03-2268-4282-9dd8-9a971ce0394e tempest-VolumesNegativeTest-1506185721 tempest-VolumesNegativeTest-1506185721-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:14:49.814923 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-2fc84e03-2268-4282-9dd8-9a971ce0394e tempest-VolumesNegativeTest-1506185721 tempest-VolumesNegativeTest-1506185721-project] [instance: b035abda-fdd9-49ac-9f24-2e72cefc1b94] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:14:49.817281 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_cell0:SELECT=2 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:14:49.817937 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_cell0:SELECT=6 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:14:49.824574 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-2fc84e03-2268-4282-9dd8-9a971ce0394e tempest-VolumesNegativeTest-1506185721 tempest-VolumesNegativeTest-1506185721-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:14:49.825036 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-2fc84e03-2268-4282-9dd8-9a971ce0394e tempest-VolumesNegativeTest-1506185721 tempest-VolumesNegativeTest-1506185721-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:14:49.825809 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-2fc84e03-2268-4282-9dd8-9a971ce0394e tempest-VolumesNegativeTest-1506185721 tempest-VolumesNegativeTest-1506185721-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:14:49.826242 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-2fc84e03-2268-4282-9dd8-9a971ce0394e tempest-VolumesNegativeTest-1506185721 tempest-VolumesNegativeTest-1506185721-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:14:49.960717 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-2fc84e03-2268-4282-9dd8-9a971ce0394e tempest-VolumesNegativeTest-1506185721 tempest-VolumesNegativeTest-1506185721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bf77869a8f84d9ca61053e6a0fc08d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74c7b1ba386348c0b22d4cc4bf296735', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:14:49.970064 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-2fc84e03-2268-4282-9dd8-9a971ce0394e tempest-VolumesNegativeTest-1506185721 tempest-VolumesNegativeTest-1506185721-project] 10.222.0.43 "GET /compute/v2.1/servers/b035abda-fdd9-49ac-9f24-2e72cefc1b94" status: 200 len: 1465 microversion: 2.1 time: 0.160043 Jun 29 08:14:49.970678 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 500/991] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:14:49 2022] GET /compute/v2.1/servers/b035abda-fdd9-49ac-9f24-2e72cefc1b94 => generated 1465 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:14:50.025368 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-01921284-9ea7-45ec-a871-8f79223f5eb5 tempest-VolumesNegativeTest-1506185721 tempest-VolumesNegativeTest-1506185721-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:14:50.025960 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-01921284-9ea7-45ec-a871-8f79223f5eb5 tempest-VolumesNegativeTest-1506185721 tempest-VolumesNegativeTest-1506185721-project] [instance: b035abda-fdd9-49ac-9f24-2e72cefc1b94] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:14:50.027875 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG dbcounter [-] [117890] Writing DB stats nova_cell0:SELECT=2 {{(pid=117890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:14:50.033604 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-01921284-9ea7-45ec-a871-8f79223f5eb5 tempest-VolumesNegativeTest-1506185721 tempest-VolumesNegativeTest-1506185721-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:14:50.034049 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-01921284-9ea7-45ec-a871-8f79223f5eb5 tempest-VolumesNegativeTest-1506185721 tempest-VolumesNegativeTest-1506185721-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:14:50.035410 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-01921284-9ea7-45ec-a871-8f79223f5eb5 tempest-VolumesNegativeTest-1506185721 tempest-VolumesNegativeTest-1506185721-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:14:50.035848 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-01921284-9ea7-45ec-a871-8f79223f5eb5 tempest-VolumesNegativeTest-1506185721 tempest-VolumesNegativeTest-1506185721-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:14:50.060541 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-01921284-9ea7-45ec-a871-8f79223f5eb5 tempest-VolumesNegativeTest-1506185721 tempest-VolumesNegativeTest-1506185721-project] [instance: b035abda-fdd9-49ac-9f24-2e72cefc1b94] Going to try to terminate instance {{(pid=117890) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 29 08:14:50.136217 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-01921284-9ea7-45ec-a871-8f79223f5eb5 tempest-VolumesNegativeTest-1506185721 tempest-VolumesNegativeTest-1506185721-project] 10.222.0.43 "DELETE /compute/v2.1/servers/b035abda-fdd9-49ac-9f24-2e72cefc1b94" status: 204 len: 0 microversion: 2.1 time: 0.114373 Jun 29 08:14:50.136950 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 492/992] 10.222.0.43 () {58 vars in 1238 bytes} [Wed Jun 29 08:14:50 2022] DELETE /compute/v2.1/servers/b035abda-fdd9-49ac-9f24-2e72cefc1b94 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 29 08:14:50.146630 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-6d346ed8-a7ae-4948-818b-ef8a2339e27a tempest-VolumesNegativeTest-1506185721 tempest-VolumesNegativeTest-1506185721-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:14:50.147246 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-6d346ed8-a7ae-4948-818b-ef8a2339e27a tempest-VolumesNegativeTest-1506185721 tempest-VolumesNegativeTest-1506185721-project] [instance: b035abda-fdd9-49ac-9f24-2e72cefc1b94] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:14:50.153290 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-6d346ed8-a7ae-4948-818b-ef8a2339e27a tempest-VolumesNegativeTest-1506185721 tempest-VolumesNegativeTest-1506185721-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:14:50.153733 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-6d346ed8-a7ae-4948-818b-ef8a2339e27a tempest-VolumesNegativeTest-1506185721 tempest-VolumesNegativeTest-1506185721-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:14:50.154502 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-6d346ed8-a7ae-4948-818b-ef8a2339e27a tempest-VolumesNegativeTest-1506185721 tempest-VolumesNegativeTest-1506185721-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:14:50.154947 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-6d346ed8-a7ae-4948-818b-ef8a2339e27a tempest-VolumesNegativeTest-1506185721 tempest-VolumesNegativeTest-1506185721-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:14:50.286888 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-6d346ed8-a7ae-4948-818b-ef8a2339e27a tempest-VolumesNegativeTest-1506185721 tempest-VolumesNegativeTest-1506185721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bf77869a8f84d9ca61053e6a0fc08d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74c7b1ba386348c0b22d4cc4bf296735', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:14:50.294377 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-6d346ed8-a7ae-4948-818b-ef8a2339e27a tempest-VolumesNegativeTest-1506185721 tempest-VolumesNegativeTest-1506185721-project] 10.222.0.43 "GET /compute/v2.1/servers/b035abda-fdd9-49ac-9f24-2e72cefc1b94" status: 200 len: 1471 microversion: 2.1 time: 0.152861 Jun 29 08:14:50.294958 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 501/993] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:14:50 2022] GET /compute/v2.1/servers/b035abda-fdd9-49ac-9f24-2e72cefc1b94 => generated 1471 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:14:51.315099 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-3b87db6e-8a61-438a-8458-205a9a322bac tempest-VolumesNegativeTest-1506185721 tempest-VolumesNegativeTest-1506185721-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:14:51.315824 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-3b87db6e-8a61-438a-8458-205a9a322bac tempest-VolumesNegativeTest-1506185721 tempest-VolumesNegativeTest-1506185721-project] [instance: b035abda-fdd9-49ac-9f24-2e72cefc1b94] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:14:51.322213 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-3b87db6e-8a61-438a-8458-205a9a322bac tempest-VolumesNegativeTest-1506185721 tempest-VolumesNegativeTest-1506185721-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:14:51.322657 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-3b87db6e-8a61-438a-8458-205a9a322bac tempest-VolumesNegativeTest-1506185721 tempest-VolumesNegativeTest-1506185721-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:14:51.323416 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-3b87db6e-8a61-438a-8458-205a9a322bac tempest-VolumesNegativeTest-1506185721 tempest-VolumesNegativeTest-1506185721-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:14:51.323850 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-3b87db6e-8a61-438a-8458-205a9a322bac tempest-VolumesNegativeTest-1506185721 tempest-VolumesNegativeTest-1506185721-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:14:51.454497 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-3b87db6e-8a61-438a-8458-205a9a322bac tempest-VolumesNegativeTest-1506185721 tempest-VolumesNegativeTest-1506185721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bf77869a8f84d9ca61053e6a0fc08d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74c7b1ba386348c0b22d4cc4bf296735', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:14:51.462828 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-3b87db6e-8a61-438a-8458-205a9a322bac tempest-VolumesNegativeTest-1506185721 tempest-VolumesNegativeTest-1506185721-project] 10.222.0.43 "GET /compute/v2.1/servers/b035abda-fdd9-49ac-9f24-2e72cefc1b94" status: 200 len: 1471 microversion: 2.1 time: 0.152993 Jun 29 08:14:51.463394 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 493/994] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:14:51 2022] GET /compute/v2.1/servers/b035abda-fdd9-49ac-9f24-2e72cefc1b94 => generated 1471 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:14:51.995908 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [req-cd6cab5c-26c8-4ed9-a2ee-2d5bbda271d2 req-e7cd2d99-d8a1-4698-bceb-7e024b7e34f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b035abda-fdd9-49ac-9f24-2e72cefc1b94", "name": "network-vif-deleted", "tag": "4b5a4551-bf64-49bb-8c65-9dfc1ef531e8"}]} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:14:52.005592 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-cd6cab5c-26c8-4ed9-a2ee-2d5bbda271d2 req-e7cd2d99-d8a1-4698-bceb-7e024b7e34f0 service nova] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:14:52.006049 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-cd6cab5c-26c8-4ed9-a2ee-2d5bbda271d2 req-e7cd2d99-d8a1-4698-bceb-7e024b7e34f0 service nova] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:14:52.017907 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.compute.server_external_events [req-cd6cab5c-26c8-4ed9-a2ee-2d5bbda271d2 req-e7cd2d99-d8a1-4698-bceb-7e024b7e34f0 service nova] Creating event network-vif-deleted:4b5a4551-bf64-49bb-8c65-9dfc1ef531e8 for instance b035abda-fdd9-49ac-9f24-2e72cefc1b94 on hv-cinder-76810 Jun 29 08:14:52.023609 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [req-cd6cab5c-26c8-4ed9-a2ee-2d5bbda271d2 req-e7cd2d99-d8a1-4698-bceb-7e024b7e34f0 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031315 Jun 29 08:14:52.024680 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 502/995] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jun 29 08:14:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:14:52.480366 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-4583e20d-d733-4e6d-9343-c4a14587d88c tempest-VolumesNegativeTest-1506185721 tempest-VolumesNegativeTest-1506185721-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:14:52.481612 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-4583e20d-d733-4e6d-9343-c4a14587d88c tempest-VolumesNegativeTest-1506185721 tempest-VolumesNegativeTest-1506185721-project] [instance: b035abda-fdd9-49ac-9f24-2e72cefc1b94] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:14:52.489287 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-4583e20d-d733-4e6d-9343-c4a14587d88c tempest-VolumesNegativeTest-1506185721 tempest-VolumesNegativeTest-1506185721-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:14:52.489774 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-4583e20d-d733-4e6d-9343-c4a14587d88c tempest-VolumesNegativeTest-1506185721 tempest-VolumesNegativeTest-1506185721-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:14:52.491113 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-4583e20d-d733-4e6d-9343-c4a14587d88c tempest-VolumesNegativeTest-1506185721 tempest-VolumesNegativeTest-1506185721-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:14:52.491113 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-4583e20d-d733-4e6d-9343-c4a14587d88c tempest-VolumesNegativeTest-1506185721 tempest-VolumesNegativeTest-1506185721-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:14:52.527859 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-4583e20d-d733-4e6d-9343-c4a14587d88c tempest-VolumesNegativeTest-1506185721 tempest-VolumesNegativeTest-1506185721-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:14:52.528314 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-4583e20d-d733-4e6d-9343-c4a14587d88c tempest-VolumesNegativeTest-1506185721 tempest-VolumesNegativeTest-1506185721-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:14:52.528765 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.objects.instance [None req-4583e20d-d733-4e6d-9343-c4a14587d88c tempest-VolumesNegativeTest-1506185721 tempest-VolumesNegativeTest-1506185721-project] Lazy-loading 'fault' on Instance uuid b035abda-fdd9-49ac-9f24-2e72cefc1b94 {{(pid=117890) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 29 08:14:52.571413 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-4583e20d-d733-4e6d-9343-c4a14587d88c tempest-VolumesNegativeTest-1506185721 tempest-VolumesNegativeTest-1506185721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bf77869a8f84d9ca61053e6a0fc08d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74c7b1ba386348c0b22d4cc4bf296735', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:14:52.578229 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-4583e20d-d733-4e6d-9343-c4a14587d88c tempest-VolumesNegativeTest-1506185721 tempest-VolumesNegativeTest-1506185721-project] 10.222.0.43 "GET /compute/v2.1/servers/b035abda-fdd9-49ac-9f24-2e72cefc1b94" status: 200 len: 1305 microversion: 2.1 time: 0.102109 Jun 29 08:14:52.578982 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 494/996] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:14:52 2022] GET /compute/v2.1/servers/b035abda-fdd9-49ac-9f24-2e72cefc1b94 => generated 1305 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:14:53.597698 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-ffb9f31d-e653-42b0-afbc-2282e8fefcb8 tempest-VolumesNegativeTest-1506185721 tempest-VolumesNegativeTest-1506185721-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:14:53.598410 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-ffb9f31d-e653-42b0-afbc-2282e8fefcb8 tempest-VolumesNegativeTest-1506185721 tempest-VolumesNegativeTest-1506185721-project] [instance: b035abda-fdd9-49ac-9f24-2e72cefc1b94] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:14:53.604780 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ffb9f31d-e653-42b0-afbc-2282e8fefcb8 tempest-VolumesNegativeTest-1506185721 tempest-VolumesNegativeTest-1506185721-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:14:53.605272 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ffb9f31d-e653-42b0-afbc-2282e8fefcb8 tempest-VolumesNegativeTest-1506185721 tempest-VolumesNegativeTest-1506185721-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:14:53.606051 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ffb9f31d-e653-42b0-afbc-2282e8fefcb8 tempest-VolumesNegativeTest-1506185721 tempest-VolumesNegativeTest-1506185721-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:14:53.606492 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ffb9f31d-e653-42b0-afbc-2282e8fefcb8 tempest-VolumesNegativeTest-1506185721 tempest-VolumesNegativeTest-1506185721-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:14:53.620287 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.wsgi [None req-ffb9f31d-e653-42b0-afbc-2282e8fefcb8 tempest-VolumesNegativeTest-1506185721 tempest-VolumesNegativeTest-1506185721-project] HTTP exception thrown: Instance b035abda-fdd9-49ac-9f24-2e72cefc1b94 could not be found. Jun 29 08:14:53.621988 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-ffb9f31d-e653-42b0-afbc-2282e8fefcb8 tempest-VolumesNegativeTest-1506185721 tempest-VolumesNegativeTest-1506185721-project] Request method failure captured: Jun 29 08:14:53.621988 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: request: GET /compute/v2.1/servers/b035abda-fdd9-49ac-9f24-2e72cefc1b94 HTTP/1.1 Jun 29 08:14:53.621988 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: Accept: application/json Jun 29 08:14:53.621988 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: Accept-Encoding: identity Jun 29 08:14:53.621988 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: Connection: close Jun 29 08:14:53.621988 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: Content-Length: 0 Jun 29 08:14:53.621988 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: Content-Type: application/json Jun 29 08:14:53.621988 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: Host: 10.222.0.43 Jun 29 08:14:53.621988 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: Openstack-System-Scope: None Jun 29 08:14:53.621988 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: User-Agent: python-urllib3/1.26.9 Jun 29 08:14:53.621988 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Auth-Token: gAAAAABivAntjqrEn-wBtUn0tLqO2nK1lviR77zucPmwvaJlXP4AbFQtBcf8r1dPNeTZyZOAfRm4Pqxw3O2s4nhvk8jImW8CpdsAchUN8wB_hQW3dvIbFHpPrKV1LADZOLigNaaLP3PSBmGCa8SAeTZec6bkWg57X1ayFGcni6CJMsaGVVXKRaE Jun 29 08:14:53.621988 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Domain-Id: None Jun 29 08:14:53.621988 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Domain-Name: None Jun 29 08:14:53.621988 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Identity-Status: Confirmed Jun 29 08:14:53.621988 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Is-Admin-Project: True Jun 29 08:14:53.621988 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Project-Domain-Id: default Jun 29 08:14:53.621988 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Project-Domain-Name: Default Jun 29 08:14:53.621988 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Project-Id: 74c7b1ba386348c0b22d4cc4bf296735 Jun 29 08:14:53.621988 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Project-Name: tempest-VolumesNegativeTest-1506185721 Jun 29 08:14:53.621988 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Role: member,reader Jun 29 08:14:53.621988 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Roles: member,reader Jun 29 08:14:53.623733 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/74c7b1ba386348c0b22d4cc4bf296735"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_74c7b1ba386348c0b22d4cc4bf296735"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/74c7b1ba386348c0b22d4cc4bf296735"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/74c7b1ba386348c0b22d4cc4bf296735"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Jun 29 08:14:53.623733 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Tenant: tempest-VolumesNegativeTest-1506185721 Jun 29 08:14:53.623733 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Tenant-Id: 74c7b1ba386348c0b22d4cc4bf296735 Jun 29 08:14:53.623733 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Tenant-Name: tempest-VolumesNegativeTest-1506185721 Jun 29 08:14:53.623733 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-User: tempest-VolumesNegativeTest-1506185721-project Jun 29 08:14:53.623733 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-User-Domain-Id: default Jun 29 08:14:53.623733 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-User-Domain-Name: Default Jun 29 08:14:53.623733 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-User-Id: 0bf77869a8f84d9ca61053e6a0fc08d9 Jun 29 08:14:53.623733 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-User-Name: tempest-VolumesNegativeTest-1506185721-project Jun 29 08:14:53.623733 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: method: > Jun 29 08:14:53.623733 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: exception: Instance b035abda-fdd9-49ac-9f24-2e72cefc1b94 could not be found. Jun 29 08:14:53.623733 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: action_args: {'id': 'b035abda-fdd9-49ac-9f24-2e72cefc1b94'} Jun 29 08:14:53.624654 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 08:14:53.624654 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:14:53.624654 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 29 08:14:53.624654 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 29 08:14:53.624654 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 29 08:14:53.624654 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 29 08:14:53.624654 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 29 08:14:53.624654 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 29 08:14:53.624654 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 29 08:14:53.624654 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 29 08:14:53.624654 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b035abda-fdd9-49ac-9f24-2e72cefc1b94 could not be found. Jun 29 08:14:53.624654 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 29 08:14:53.624654 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 08:14:53.624654 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 29 08:14:53.624654 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:14:53.624654 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 08:14:53.624654 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 08:14:53.624654 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 08:14:53.624654 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 08:14:53.624654 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 08:14:53.626281 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 08:14:53.626281 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 29 08:14:53.626281 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 29 08:14:53.626281 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 29 08:14:53.626281 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 29 08:14:53.626281 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 29 08:14:53.626281 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 29 08:14:53.626281 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b035abda-fdd9-49ac-9f24-2e72cefc1b94 could not be found. Jun 29 08:14:53.626281 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 29 08:14:53.626281 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 08:14:53.626281 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 29 08:14:53.626281 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:14:53.626281 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 08:14:53.626281 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 08:14:53.626281 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 08:14:53.626281 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 08:14:53.626281 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b035abda-fdd9-49ac-9f24-2e72cefc1b94 could not be found. Jun 29 08:14:53.626281 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 29 08:14:53.627585 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-ffb9f31d-e653-42b0-afbc-2282e8fefcb8 tempest-VolumesNegativeTest-1506185721 tempest-VolumesNegativeTest-1506185721-project] Returning 404 to user: Instance b035abda-fdd9-49ac-9f24-2e72cefc1b94 could not be found. {{(pid=117889) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 08:14:53.627585 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-ffb9f31d-e653-42b0-afbc-2282e8fefcb8 tempest-VolumesNegativeTest-1506185721 tempest-VolumesNegativeTest-1506185721-project] 10.222.0.43 "GET /compute/v2.1/servers/b035abda-fdd9-49ac-9f24-2e72cefc1b94" status: 404 len: 111 microversion: 2.1 time: 0.031283 Jun 29 08:14:53.627585 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 503/997] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:14:53 2022] GET /compute/v2.1/servers/b035abda-fdd9-49ac-9f24-2e72cefc1b94 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 29 08:15:07.995535 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG dbcounter [-] [117890] Writing DB stats nova_api:SELECT=27,nova_api:UPDATE=1 {{(pid=117890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:15:07.996262 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG dbcounter [-] [117890] Writing DB stats nova_cell1:SELECT=58,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:15:08.196128 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-e12c78d1-52e1-4cd4-aae3-0466f8539a0d tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Action: 'create', calling method: .version_select at 0x7f7245c000d0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-2054109478", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLn4oT4U26530kt5wN0EqI8HmRaQbWEWMnEdby48mZ2KvLbBYd6dEQ3/UuJzaeIcZ2j1WCYwf9cjlUwHg45L1/uLtSL6lW4ZfdImuHpDNIxEFhrm5v3D3RAP7nzTKAydaQ=="}} {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:15:08.212046 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.quota [None req-e12c78d1-52e1-4cd4-aae3-0466f8539a0d tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Getting quotas for project 1d0c865636434569b3e25362dc02d5b8. Resources: {'key_pairs'} {{(pid=117890) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 29 08:15:08.216643 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.quota [None req-e12c78d1-52e1-4cd4-aae3-0466f8539a0d tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Getting quotas for user 36fcd3d9c490413ab9429bccdad444cb and project 1d0c865636434569b3e25362dc02d5b8. Resources: {'key_pairs'} {{(pid=117890) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 29 08:15:08.241378 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-e12c78d1-52e1-4cd4-aae3-0466f8539a0d tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.250669 Jun 29 08:15:08.246759 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 495/998] 10.222.0.43 () {60 vars in 1158 bytes} [Wed Jun 29 08:15:07 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:15:23.442677 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-c8e7e2ae-268e-4371-809e-973dfd1e8800 tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-2000014124", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-2054109478", "security_groups": [{"name": "tempest-secgroup-smoke-795901347"}], "block_device_mapping_v2": [{"uuid": "277f1630-1dc3-45ad-bb54-48a27eaec124", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "4f989f48-15ed-4255-b1c5-b3741c687df0"}]}} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:15:23.451829 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:15:23.452476 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_cell1:SELECT=40 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:15:23.560687 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.network.neutron [None req-c8e7e2ae-268e-4371-809e-973dfd1e8800 tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] validate_networks() for [('4f989f48-15ed-4255-b1c5-b3741c687df0', None, None, None, None, None)] {{(pid=117889) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 29 08:15:24.037431 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.virt.hardware [None req-c8e7e2ae-268e-4371-809e-973dfd1e8800 tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Flavor limits 0:0:0 {{(pid=117889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 29 08:15:24.037860 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.virt.hardware [None req-c8e7e2ae-268e-4371-809e-973dfd1e8800 tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Image limits 0:0:0 {{(pid=117889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 29 08:15:24.038335 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.virt.hardware [None req-c8e7e2ae-268e-4371-809e-973dfd1e8800 tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Flavor pref 0:0:0 {{(pid=117889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 29 08:15:24.038753 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.virt.hardware [None req-c8e7e2ae-268e-4371-809e-973dfd1e8800 tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Image pref 0:0:0 {{(pid=117889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 29 08:15:24.039166 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.virt.hardware [None req-c8e7e2ae-268e-4371-809e-973dfd1e8800 tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 29 08:15:24.048388 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c8e7e2ae-268e-4371-809e-973dfd1e8800 tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:15:24.048837 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c8e7e2ae-268e-4371-809e-973dfd1e8800 tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:15:24.049680 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c8e7e2ae-268e-4371-809e-973dfd1e8800 tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:15:24.050141 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c8e7e2ae-268e-4371-809e-973dfd1e8800 tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:15:24.067731 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.quota [None req-c8e7e2ae-268e-4371-809e-973dfd1e8800 tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Getting quotas for project 1d0c865636434569b3e25362dc02d5b8. Resources: {'ram', 'instances', 'cores'} {{(pid=117889) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 29 08:15:24.072568 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.quota [None req-c8e7e2ae-268e-4371-809e-973dfd1e8800 tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Getting quotas for user 36fcd3d9c490413ab9429bccdad444cb and project 1d0c865636434569b3e25362dc02d5b8. Resources: {'ram', 'instances', 'cores'} {{(pid=117889) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 29 08:15:24.129704 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-c8e7e2ae-268e-4371-809e-973dfd1e8800 tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Going to run 1 instances... {{(pid=117889) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 29 08:15:24.131808 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-c8e7e2ae-268e-4371-809e-973dfd1e8800 tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] [instance: d211a2b0-7991-46ac-9231-06e79c90778a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='277f1630-1dc3-45ad-bb54-48a27eaec124',volume_size=None,volume_type=None)] {{(pid=117889) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 29 08:15:24.260478 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-c8e7e2ae-268e-4371-809e-973dfd1e8800 tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.821728 Jun 29 08:15:24.261140 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 504/999] 10.222.0.43 () {60 vars in 1146 bytes} [Wed Jun 29 08:15:23 2022] POST /compute/v2.1/servers => generated 405 bytes in 823 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 29 08:15:24.275356 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-09ee33d8-0d8b-41a6-a564-cf2e1d718ff0 tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:15:24.275949 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-09ee33d8-0d8b-41a6-a564-cf2e1d718ff0 tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] [instance: d211a2b0-7991-46ac-9231-06e79c90778a] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:15:24.278346 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG dbcounter [-] [117890] Writing DB stats nova_cell0:SELECT=4 {{(pid=117890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:15:24.279006 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG dbcounter [-] [117890] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=117890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:15:24.336488 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-09ee33d8-0d8b-41a6-a564-cf2e1d718ff0 tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36fcd3d9c490413ab9429bccdad444cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d0c865636434569b3e25362dc02d5b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:15:24.343351 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-09ee33d8-0d8b-41a6-a564-cf2e1d718ff0 tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] 10.222.0.43 "GET /compute/v2.1/servers/d211a2b0-7991-46ac-9231-06e79c90778a" status: 200 len: 1095 microversion: 2.1 time: 0.072467 Jun 29 08:15:24.343971 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 496/1000] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:15:24 2022] GET /compute/v2.1/servers/d211a2b0-7991-46ac-9231-06e79c90778a => generated 1095 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:15:25.361355 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-c881a8d9-85c1-4f64-a76b-9c3af1e5c37f tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:15:25.361969 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-c881a8d9-85c1-4f64-a76b-9c3af1e5c37f tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] [instance: d211a2b0-7991-46ac-9231-06e79c90778a] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:15:25.368103 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c881a8d9-85c1-4f64-a76b-9c3af1e5c37f tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:15:25.368544 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c881a8d9-85c1-4f64-a76b-9c3af1e5c37f tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:15:25.369335 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c881a8d9-85c1-4f64-a76b-9c3af1e5c37f tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:15:25.369769 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c881a8d9-85c1-4f64-a76b-9c3af1e5c37f tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:15:25.441170 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-c881a8d9-85c1-4f64-a76b-9c3af1e5c37f tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36fcd3d9c490413ab9429bccdad444cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d0c865636434569b3e25362dc02d5b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:15:25.449969 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-c881a8d9-85c1-4f64-a76b-9c3af1e5c37f tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] 10.222.0.43 "GET /compute/v2.1/servers/d211a2b0-7991-46ac-9231-06e79c90778a" status: 200 len: 1211 microversion: 2.1 time: 0.092449 Jun 29 08:15:25.450184 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 505/1001] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:15:25 2022] GET /compute/v2.1/servers/d211a2b0-7991-46ac-9231-06e79c90778a => generated 1211 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:15:26.466983 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-f44ab812-6bdd-4300-a6d1-dc0510e72a96 tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:15:26.467584 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-f44ab812-6bdd-4300-a6d1-dc0510e72a96 tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] [instance: d211a2b0-7991-46ac-9231-06e79c90778a] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:15:26.475098 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-f44ab812-6bdd-4300-a6d1-dc0510e72a96 tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:15:26.475546 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-f44ab812-6bdd-4300-a6d1-dc0510e72a96 tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:15:26.476527 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-f44ab812-6bdd-4300-a6d1-dc0510e72a96 tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:15:26.476998 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-f44ab812-6bdd-4300-a6d1-dc0510e72a96 tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:15:26.703362 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-f44ab812-6bdd-4300-a6d1-dc0510e72a96 tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36fcd3d9c490413ab9429bccdad444cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d0c865636434569b3e25362dc02d5b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:15:26.711489 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-f44ab812-6bdd-4300-a6d1-dc0510e72a96 tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] 10.222.0.43 "GET /compute/v2.1/servers/d211a2b0-7991-46ac-9231-06e79c90778a" status: 200 len: 1266 microversion: 2.1 time: 0.248326 Jun 29 08:15:26.712597 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 497/1002] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:15:26 2022] GET /compute/v2.1/servers/d211a2b0-7991-46ac-9231-06e79c90778a => generated 1266 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:15:26.728460 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [req-5e22b20b-d25d-4fb8-875d-b1ad271b3d33 req-684b8569-00f9-4913-a10c-d51ba4c63f2e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d211a2b0-7991-46ac-9231-06e79c90778a", "tag": "a43f8e34-a4b0-4c2d-8efe-28a159d61f13"}]} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:15:26.746793 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-5e22b20b-d25d-4fb8-875d-b1ad271b3d33 req-684b8569-00f9-4913-a10c-d51ba4c63f2e service nova] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:15:26.747251 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-5e22b20b-d25d-4fb8-875d-b1ad271b3d33 req-684b8569-00f9-4913-a10c-d51ba4c63f2e service nova] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:15:26.759817 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.compute.server_external_events [req-5e22b20b-d25d-4fb8-875d-b1ad271b3d33 req-684b8569-00f9-4913-a10c-d51ba4c63f2e service nova] Creating event network-changed:a43f8e34-a4b0-4c2d-8efe-28a159d61f13 for instance d211a2b0-7991-46ac-9231-06e79c90778a on hv-cinder-76810 Jun 29 08:15:26.764876 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [req-5e22b20b-d25d-4fb8-875d-b1ad271b3d33 req-684b8569-00f9-4913-a10c-d51ba4c63f2e service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043699 Jun 29 08:15:26.768569 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 506/1003] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jun 29 08:15:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:15:27.729525 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-214f7221-44ba-4548-8751-d934083c2f80 tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:15:27.730200 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-214f7221-44ba-4548-8751-d934083c2f80 tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] [instance: d211a2b0-7991-46ac-9231-06e79c90778a] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:15:27.736971 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-214f7221-44ba-4548-8751-d934083c2f80 tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:15:27.737455 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-214f7221-44ba-4548-8751-d934083c2f80 tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:15:27.738229 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-214f7221-44ba-4548-8751-d934083c2f80 tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:15:27.738671 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-214f7221-44ba-4548-8751-d934083c2f80 tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:15:27.957523 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-214f7221-44ba-4548-8751-d934083c2f80 tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36fcd3d9c490413ab9429bccdad444cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d0c865636434569b3e25362dc02d5b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:15:27.966504 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-214f7221-44ba-4548-8751-d934083c2f80 tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] 10.222.0.43 "GET /compute/v2.1/servers/d211a2b0-7991-46ac-9231-06e79c90778a" status: 200 len: 1266 microversion: 2.1 time: 0.241415 Jun 29 08:15:27.967080 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 498/1004] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:15:27 2022] GET /compute/v2.1/servers/d211a2b0-7991-46ac-9231-06e79c90778a => generated 1266 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:15:28.984649 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-b750c58a-eb3e-46c0-9ffd-dc7166b4c529 tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:15:28.985266 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-b750c58a-eb3e-46c0-9ffd-dc7166b4c529 tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] [instance: d211a2b0-7991-46ac-9231-06e79c90778a] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:15:28.992298 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-b750c58a-eb3e-46c0-9ffd-dc7166b4c529 tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:15:28.992741 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-b750c58a-eb3e-46c0-9ffd-dc7166b4c529 tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:15:28.993547 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-b750c58a-eb3e-46c0-9ffd-dc7166b4c529 tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:15:28.993984 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-b750c58a-eb3e-46c0-9ffd-dc7166b4c529 tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:15:29.127183 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-b750c58a-eb3e-46c0-9ffd-dc7166b4c529 tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36fcd3d9c490413ab9429bccdad444cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d0c865636434569b3e25362dc02d5b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:15:29.134804 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-b750c58a-eb3e-46c0-9ffd-dc7166b4c529 tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] 10.222.0.43 "GET /compute/v2.1/servers/d211a2b0-7991-46ac-9231-06e79c90778a" status: 200 len: 1266 microversion: 2.1 time: 0.155368 Jun 29 08:15:29.135361 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 507/1005] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:15:28 2022] GET /compute/v2.1/servers/d211a2b0-7991-46ac-9231-06e79c90778a => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:15:30.151590 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-4e712e4b-f890-4279-99d9-b3dcf72317f0 tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:15:30.152255 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-4e712e4b-f890-4279-99d9-b3dcf72317f0 tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] [instance: d211a2b0-7991-46ac-9231-06e79c90778a] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:15:30.158729 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-4e712e4b-f890-4279-99d9-b3dcf72317f0 tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:15:30.159214 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-4e712e4b-f890-4279-99d9-b3dcf72317f0 tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:15:30.159988 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-4e712e4b-f890-4279-99d9-b3dcf72317f0 tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:15:30.160430 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-4e712e4b-f890-4279-99d9-b3dcf72317f0 tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:15:30.537302 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-4e712e4b-f890-4279-99d9-b3dcf72317f0 tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36fcd3d9c490413ab9429bccdad444cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d0c865636434569b3e25362dc02d5b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:15:30.544956 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-4e712e4b-f890-4279-99d9-b3dcf72317f0 tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] 10.222.0.43 "GET /compute/v2.1/servers/d211a2b0-7991-46ac-9231-06e79c90778a" status: 200 len: 1266 microversion: 2.1 time: 0.397315 Jun 29 08:15:30.545541 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 499/1006] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:15:30 2022] GET /compute/v2.1/servers/d211a2b0-7991-46ac-9231-06e79c90778a => generated 1266 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:15:31.562570 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-c16bf796-9574-4f12-bfb3-dc2de7b17cce tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:15:31.563181 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-c16bf796-9574-4f12-bfb3-dc2de7b17cce tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] [instance: d211a2b0-7991-46ac-9231-06e79c90778a] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:15:31.570204 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c16bf796-9574-4f12-bfb3-dc2de7b17cce tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:15:31.570655 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c16bf796-9574-4f12-bfb3-dc2de7b17cce tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:15:31.571422 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c16bf796-9574-4f12-bfb3-dc2de7b17cce tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:15:31.571860 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c16bf796-9574-4f12-bfb3-dc2de7b17cce tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:15:31.701650 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-c16bf796-9574-4f12-bfb3-dc2de7b17cce tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36fcd3d9c490413ab9429bccdad444cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d0c865636434569b3e25362dc02d5b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:15:31.709214 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-c16bf796-9574-4f12-bfb3-dc2de7b17cce tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] 10.222.0.43 "GET /compute/v2.1/servers/d211a2b0-7991-46ac-9231-06e79c90778a" status: 200 len: 1266 microversion: 2.1 time: 0.150530 Jun 29 08:15:31.710387 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 508/1007] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:15:31 2022] GET /compute/v2.1/servers/d211a2b0-7991-46ac-9231-06e79c90778a => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:15:32.726969 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-b41a0840-6310-4e36-b2fd-946e555d8a76 tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:15:32.727572 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-b41a0840-6310-4e36-b2fd-946e555d8a76 tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] [instance: d211a2b0-7991-46ac-9231-06e79c90778a] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:15:32.734101 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-b41a0840-6310-4e36-b2fd-946e555d8a76 tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:15:32.734545 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-b41a0840-6310-4e36-b2fd-946e555d8a76 tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:15:32.735304 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-b41a0840-6310-4e36-b2fd-946e555d8a76 tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:15:32.735739 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-b41a0840-6310-4e36-b2fd-946e555d8a76 tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:15:32.865031 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-b41a0840-6310-4e36-b2fd-946e555d8a76 tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36fcd3d9c490413ab9429bccdad444cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d0c865636434569b3e25362dc02d5b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:15:32.872735 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-b41a0840-6310-4e36-b2fd-946e555d8a76 tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] 10.222.0.43 "GET /compute/v2.1/servers/d211a2b0-7991-46ac-9231-06e79c90778a" status: 200 len: 1266 microversion: 2.1 time: 0.150183 Jun 29 08:15:32.873334 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 500/1008] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:15:32 2022] GET /compute/v2.1/servers/d211a2b0-7991-46ac-9231-06e79c90778a => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:15:33.889797 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-1eab09fa-0c2e-4e30-b322-66315b9f6dd7 tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:15:33.890399 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-1eab09fa-0c2e-4e30-b322-66315b9f6dd7 tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] [instance: d211a2b0-7991-46ac-9231-06e79c90778a] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:15:33.896997 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-1eab09fa-0c2e-4e30-b322-66315b9f6dd7 tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:15:33.897781 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-1eab09fa-0c2e-4e30-b322-66315b9f6dd7 tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:15:33.898444 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-1eab09fa-0c2e-4e30-b322-66315b9f6dd7 tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:15:33.898893 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-1eab09fa-0c2e-4e30-b322-66315b9f6dd7 tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:15:34.033725 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-1eab09fa-0c2e-4e30-b322-66315b9f6dd7 tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36fcd3d9c490413ab9429bccdad444cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d0c865636434569b3e25362dc02d5b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:15:34.042051 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-1eab09fa-0c2e-4e30-b322-66315b9f6dd7 tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] 10.222.0.43 "GET /compute/v2.1/servers/d211a2b0-7991-46ac-9231-06e79c90778a" status: 200 len: 1266 microversion: 2.1 time: 0.156094 Jun 29 08:15:34.042631 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 509/1009] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:15:33 2022] GET /compute/v2.1/servers/d211a2b0-7991-46ac-9231-06e79c90778a => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:15:35.059523 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-7329ef0c-c944-4736-a796-2baa0057b6eb tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:15:35.060136 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-7329ef0c-c944-4736-a796-2baa0057b6eb tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] [instance: d211a2b0-7991-46ac-9231-06e79c90778a] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:15:35.062519 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG dbcounter [-] [117890] Writing DB stats nova_cell0:SELECT=2 {{(pid=117890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:15:35.067866 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-7329ef0c-c944-4736-a796-2baa0057b6eb tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:15:35.068318 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-7329ef0c-c944-4736-a796-2baa0057b6eb tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:15:35.069759 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-7329ef0c-c944-4736-a796-2baa0057b6eb tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:15:35.070200 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-7329ef0c-c944-4736-a796-2baa0057b6eb tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:15:35.212184 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-7329ef0c-c944-4736-a796-2baa0057b6eb tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36fcd3d9c490413ab9429bccdad444cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d0c865636434569b3e25362dc02d5b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:15:35.219842 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-7329ef0c-c944-4736-a796-2baa0057b6eb tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] 10.222.0.43 "GET /compute/v2.1/servers/d211a2b0-7991-46ac-9231-06e79c90778a" status: 200 len: 1266 microversion: 2.1 time: 0.164217 Jun 29 08:15:35.220407 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 501/1010] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:15:35 2022] GET /compute/v2.1/servers/d211a2b0-7991-46ac-9231-06e79c90778a => generated 1266 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 08:15:36.184026 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [req-f1367370-2464-4c41-90b0-cebbc237c137 req-ec6fb870-b94d-47d6-a669-442d4eab0e81 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d211a2b0-7991-46ac-9231-06e79c90778a", "name": "network-vif-plugged", "status": "completed", "tag": "a43f8e34-a4b0-4c2d-8efe-28a159d61f13"}]} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:15:36.187793 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_cell0:SELECT=2 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:15:36.188425 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_cell0:SELECT=6 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:15:36.194918 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-f1367370-2464-4c41-90b0-cebbc237c137 req-ec6fb870-b94d-47d6-a669-442d4eab0e81 service nova] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:15:36.195373 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-f1367370-2464-4c41-90b0-cebbc237c137 req-ec6fb870-b94d-47d6-a669-442d4eab0e81 service nova] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:15:36.207557 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.compute.server_external_events [req-f1367370-2464-4c41-90b0-cebbc237c137 req-ec6fb870-b94d-47d6-a669-442d4eab0e81 service nova] Creating event network-vif-plugged:a43f8e34-a4b0-4c2d-8efe-28a159d61f13 for instance d211a2b0-7991-46ac-9231-06e79c90778a on hv-cinder-76810 Jun 29 08:15:36.213619 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [req-f1367370-2464-4c41-90b0-cebbc237c137 req-ec6fb870-b94d-47d6-a669-442d4eab0e81 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033605 Jun 29 08:15:36.214230 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 510/1011] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jun 29 08:15:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:15:36.237675 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-170bc263-faf3-4818-8a53-98cda74ae4d3 tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:15:36.238465 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-170bc263-faf3-4818-8a53-98cda74ae4d3 tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] [instance: d211a2b0-7991-46ac-9231-06e79c90778a] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:15:36.246996 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-170bc263-faf3-4818-8a53-98cda74ae4d3 tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:15:36.247451 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-170bc263-faf3-4818-8a53-98cda74ae4d3 tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:15:36.249331 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-170bc263-faf3-4818-8a53-98cda74ae4d3 tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:15:36.249859 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-170bc263-faf3-4818-8a53-98cda74ae4d3 tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:15:36.397618 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-170bc263-faf3-4818-8a53-98cda74ae4d3 tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36fcd3d9c490413ab9429bccdad444cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d0c865636434569b3e25362dc02d5b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:15:36.406426 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-170bc263-faf3-4818-8a53-98cda74ae4d3 tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] 10.222.0.43 "GET /compute/v2.1/servers/d211a2b0-7991-46ac-9231-06e79c90778a" status: 200 len: 1266 microversion: 2.1 time: 0.173574 Jun 29 08:15:36.406995 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 502/1012] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:15:36 2022] GET /compute/v2.1/servers/d211a2b0-7991-46ac-9231-06e79c90778a => generated 1266 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:15:37.425063 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-472da77c-4377-40e5-b477-d806dfadd787 tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:15:37.425832 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-472da77c-4377-40e5-b477-d806dfadd787 tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] [instance: d211a2b0-7991-46ac-9231-06e79c90778a] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:15:37.434145 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-472da77c-4377-40e5-b477-d806dfadd787 tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:15:37.434596 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-472da77c-4377-40e5-b477-d806dfadd787 tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:15:37.435376 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-472da77c-4377-40e5-b477-d806dfadd787 tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:15:37.435818 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-472da77c-4377-40e5-b477-d806dfadd787 tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:15:37.569846 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-472da77c-4377-40e5-b477-d806dfadd787 tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36fcd3d9c490413ab9429bccdad444cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d0c865636434569b3e25362dc02d5b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:15:37.577695 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-472da77c-4377-40e5-b477-d806dfadd787 tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] 10.222.0.43 "GET /compute/v2.1/servers/d211a2b0-7991-46ac-9231-06e79c90778a" status: 200 len: 1266 microversion: 2.1 time: 0.157757 Jun 29 08:15:37.578267 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 511/1013] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:15:37 2022] GET /compute/v2.1/servers/d211a2b0-7991-46ac-9231-06e79c90778a => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:15:38.594733 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-2f24016b-9660-4800-be32-a57215f4741b tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:15:38.595341 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-2f24016b-9660-4800-be32-a57215f4741b tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] [instance: d211a2b0-7991-46ac-9231-06e79c90778a] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:15:38.603065 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-2f24016b-9660-4800-be32-a57215f4741b tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:15:38.603512 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-2f24016b-9660-4800-be32-a57215f4741b tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:15:38.604286 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-2f24016b-9660-4800-be32-a57215f4741b tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:15:38.604722 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-2f24016b-9660-4800-be32-a57215f4741b tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:15:38.734392 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-2f24016b-9660-4800-be32-a57215f4741b tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36fcd3d9c490413ab9429bccdad444cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d0c865636434569b3e25362dc02d5b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:15:38.742616 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-2f24016b-9660-4800-be32-a57215f4741b tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] 10.222.0.43 "GET /compute/v2.1/servers/d211a2b0-7991-46ac-9231-06e79c90778a" status: 200 len: 1453 microversion: 2.1 time: 0.151728 Jun 29 08:15:38.743103 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 503/1014] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:15:38 2022] GET /compute/v2.1/servers/d211a2b0-7991-46ac-9231-06e79c90778a => generated 1453 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:15:38.759136 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-513c645b-9f74-4864-883e-242632b11bac tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:15:38.759743 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-513c645b-9f74-4864-883e-242632b11bac tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] [instance: d211a2b0-7991-46ac-9231-06e79c90778a] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:15:38.766155 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-513c645b-9f74-4864-883e-242632b11bac tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:15:38.766597 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-513c645b-9f74-4864-883e-242632b11bac tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:15:38.767355 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-513c645b-9f74-4864-883e-242632b11bac tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:15:38.767795 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-513c645b-9f74-4864-883e-242632b11bac tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:15:38.900372 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-513c645b-9f74-4864-883e-242632b11bac tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36fcd3d9c490413ab9429bccdad444cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d0c865636434569b3e25362dc02d5b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:15:38.907978 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-513c645b-9f74-4864-883e-242632b11bac tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] 10.222.0.43 "GET /compute/v2.1/servers/d211a2b0-7991-46ac-9231-06e79c90778a" status: 200 len: 1453 microversion: 2.1 time: 0.153565 Jun 29 08:15:38.908551 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 512/1015] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:15:38 2022] GET /compute/v2.1/servers/d211a2b0-7991-46ac-9231-06e79c90778a => generated 1453 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:15:40.620064 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [req-4f14eed4-44cf-465e-a952-835a9d4713d8 req-dabedee4-721a-4fb1-aaf7-6c5b31bd5caa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d211a2b0-7991-46ac-9231-06e79c90778a", "tag": "a43f8e34-a4b0-4c2d-8efe-28a159d61f13"}]} {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:15:40.634626 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [req-4f14eed4-44cf-465e-a952-835a9d4713d8 req-dabedee4-721a-4fb1-aaf7-6c5b31bd5caa service nova] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:15:40.635080 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [req-4f14eed4-44cf-465e-a952-835a9d4713d8 req-dabedee4-721a-4fb1-aaf7-6c5b31bd5caa service nova] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:15:40.647091 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.compute.server_external_events [req-4f14eed4-44cf-465e-a952-835a9d4713d8 req-dabedee4-721a-4fb1-aaf7-6c5b31bd5caa service nova] Creating event network-changed:a43f8e34-a4b0-4c2d-8efe-28a159d61f13 for instance d211a2b0-7991-46ac-9231-06e79c90778a on hv-cinder-76810 Jun 29 08:15:40.652414 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [req-4f14eed4-44cf-465e-a952-835a9d4713d8 req-dabedee4-721a-4fb1-aaf7-6c5b31bd5caa service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.130473 Jun 29 08:15:40.653040 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 504/1016] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jun 29 08:15:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:17:34.805897 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR oslo.messaging._drivers.impl_rabbit [-] [608f25d5-a1de-4e5f-9a4d-b2ed9aa3e1b5] AMQP server on 10.222.0.43:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jun 29 08:17:34.806493 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:17:34.807177 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_cell1:SELECT=42 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:17:34.811124 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-56afd0ce-bdc7-4ccf-8cb5-6feffa3220b6 tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:17:34.811670 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-56afd0ce-bdc7-4ccf-8cb5-6feffa3220b6 tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] [instance: d211a2b0-7991-46ac-9231-06e79c90778a] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:17:34.818856 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-56afd0ce-bdc7-4ccf-8cb5-6feffa3220b6 tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:17:34.819303 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-56afd0ce-bdc7-4ccf-8cb5-6feffa3220b6 tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:17:34.820071 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-56afd0ce-bdc7-4ccf-8cb5-6feffa3220b6 tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:17:34.820507 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-56afd0ce-bdc7-4ccf-8cb5-6feffa3220b6 tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:17:34.846268 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-56afd0ce-bdc7-4ccf-8cb5-6feffa3220b6 tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] [instance: d211a2b0-7991-46ac-9231-06e79c90778a] Going to try to terminate instance {{(pid=117889) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 29 08:17:34.921699 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-56afd0ce-bdc7-4ccf-8cb5-6feffa3220b6 tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] 10.222.0.43 "DELETE /compute/v2.1/servers/d211a2b0-7991-46ac-9231-06e79c90778a" status: 204 len: 0 microversion: 2.1 time: 0.117750 Jun 29 08:17:34.922285 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 513/1017] 10.222.0.43 () {58 vars in 1238 bytes} [Wed Jun 29 08:17:34 2022] DELETE /compute/v2.1/servers/d211a2b0-7991-46ac-9231-06e79c90778a => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 29 08:17:34.929462 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR oslo.messaging._drivers.impl_rabbit [-] [82be6a7d-6848-4be5-8825-89feb596d46e] AMQP server on 10.222.0.43:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 29 08:17:34.930073 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG dbcounter [-] [117890] Writing DB stats nova_api:SELECT=20 {{(pid=117890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:17:34.931080 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG dbcounter [-] [117890] Writing DB stats nova_cell1:SELECT=44 {{(pid=117890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:17:34.935709 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-850eefb3-2d2e-46d0-8709-314f51b92267 tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:17:34.936414 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-850eefb3-2d2e-46d0-8709-314f51b92267 tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] [instance: d211a2b0-7991-46ac-9231-06e79c90778a] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:17:34.943958 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-850eefb3-2d2e-46d0-8709-314f51b92267 tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:17:34.944408 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-850eefb3-2d2e-46d0-8709-314f51b92267 tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:17:34.945392 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-850eefb3-2d2e-46d0-8709-314f51b92267 tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:17:34.945874 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-850eefb3-2d2e-46d0-8709-314f51b92267 tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:17:35.086864 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-850eefb3-2d2e-46d0-8709-314f51b92267 tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36fcd3d9c490413ab9429bccdad444cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d0c865636434569b3e25362dc02d5b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:17:35.094496 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-850eefb3-2d2e-46d0-8709-314f51b92267 tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] 10.222.0.43 "GET /compute/v2.1/servers/d211a2b0-7991-46ac-9231-06e79c90778a" status: 200 len: 1578 microversion: 2.1 time: 0.167612 Jun 29 08:17:35.095056 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 505/1018] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:17:34 2022] GET /compute/v2.1/servers/d211a2b0-7991-46ac-9231-06e79c90778a => generated 1578 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:17:36.111925 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-7988ce23-9b62-4353-b016-2a3af07d1abd tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:17:36.112653 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-7988ce23-9b62-4353-b016-2a3af07d1abd tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] [instance: d211a2b0-7991-46ac-9231-06e79c90778a] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:17:36.123912 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-7988ce23-9b62-4353-b016-2a3af07d1abd tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:17:36.124379 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-7988ce23-9b62-4353-b016-2a3af07d1abd tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:17:36.125273 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-7988ce23-9b62-4353-b016-2a3af07d1abd tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:17:36.125711 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-7988ce23-9b62-4353-b016-2a3af07d1abd tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:17:36.129272 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO oslo.messaging._drivers.impl_rabbit [-] [608f25d5-a1de-4e5f-9a4d-b2ed9aa3e1b5] Reconnected to AMQP server on 10.222.0.43:5672 via [amqp] client with port 32950. Jun 29 08:17:36.271821 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-7988ce23-9b62-4353-b016-2a3af07d1abd tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36fcd3d9c490413ab9429bccdad444cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d0c865636434569b3e25362dc02d5b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:17:36.279424 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-7988ce23-9b62-4353-b016-2a3af07d1abd tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] 10.222.0.43 "GET /compute/v2.1/servers/d211a2b0-7991-46ac-9231-06e79c90778a" status: 200 len: 1578 microversion: 2.1 time: 0.171929 Jun 29 08:17:36.279987 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 514/1019] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:17:36 2022] GET /compute/v2.1/servers/d211a2b0-7991-46ac-9231-06e79c90778a => generated 1578 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:17:37.298941 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-0be744f4-b2e0-45da-ac4d-451bf8050efb tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:17:37.299563 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-0be744f4-b2e0-45da-ac4d-451bf8050efb tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] [instance: d211a2b0-7991-46ac-9231-06e79c90778a] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:17:37.309361 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-0be744f4-b2e0-45da-ac4d-451bf8050efb tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:17:37.309819 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-0be744f4-b2e0-45da-ac4d-451bf8050efb tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:17:37.310606 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-0be744f4-b2e0-45da-ac4d-451bf8050efb tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:17:37.311050 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-0be744f4-b2e0-45da-ac4d-451bf8050efb tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:17:37.317923 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO oslo.messaging._drivers.impl_rabbit [-] [82be6a7d-6848-4be5-8825-89feb596d46e] Reconnected to AMQP server on 10.222.0.43:5672 via [amqp] client with port 32956. Jun 29 08:17:37.401158 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-0be744f4-b2e0-45da-ac4d-451bf8050efb tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36fcd3d9c490413ab9429bccdad444cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d0c865636434569b3e25362dc02d5b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:17:37.409103 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-0be744f4-b2e0-45da-ac4d-451bf8050efb tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] 10.222.0.43 "GET /compute/v2.1/servers/d211a2b0-7991-46ac-9231-06e79c90778a" status: 200 len: 1511 microversion: 2.1 time: 0.115222 Jun 29 08:17:37.418200 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 506/1020] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:17:37 2022] GET /compute/v2.1/servers/d211a2b0-7991-46ac-9231-06e79c90778a => generated 1511 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:17:37.493870 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [req-4faf3c40-f412-43ec-ab83-f245685f7321 req-8dcbbb4a-a54d-455e-be8b-b2071b4ccb10 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d211a2b0-7991-46ac-9231-06e79c90778a", "name": "network-vif-deleted", "tag": "a43f8e34-a4b0-4c2d-8efe-28a159d61f13"}]} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:17:37.505019 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-4faf3c40-f412-43ec-ab83-f245685f7321 req-8dcbbb4a-a54d-455e-be8b-b2071b4ccb10 service nova] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:17:37.505477 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-4faf3c40-f412-43ec-ab83-f245685f7321 req-8dcbbb4a-a54d-455e-be8b-b2071b4ccb10 service nova] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:17:37.517627 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.compute.server_external_events [req-4faf3c40-f412-43ec-ab83-f245685f7321 req-8dcbbb4a-a54d-455e-be8b-b2071b4ccb10 service nova] Creating event network-vif-deleted:a43f8e34-a4b0-4c2d-8efe-28a159d61f13 for instance d211a2b0-7991-46ac-9231-06e79c90778a on hv-cinder-76810 Jun 29 08:17:37.522598 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [req-4faf3c40-f412-43ec-ab83-f245685f7321 req-8dcbbb4a-a54d-455e-be8b-b2071b4ccb10 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032452 Jun 29 08:17:37.523532 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 515/1021] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jun 29 08:17:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:17:38.426436 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-d20ff7d3-eeb9-44e1-8d1d-a91edf91bfaf tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:17:38.427012 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-d20ff7d3-eeb9-44e1-8d1d-a91edf91bfaf tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] [instance: d211a2b0-7991-46ac-9231-06e79c90778a] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:17:38.434010 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-d20ff7d3-eeb9-44e1-8d1d-a91edf91bfaf tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:17:38.434491 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-d20ff7d3-eeb9-44e1-8d1d-a91edf91bfaf tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:17:38.435267 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-d20ff7d3-eeb9-44e1-8d1d-a91edf91bfaf tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:17:38.435709 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-d20ff7d3-eeb9-44e1-8d1d-a91edf91bfaf tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:17:38.449364 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.wsgi [None req-d20ff7d3-eeb9-44e1-8d1d-a91edf91bfaf tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] HTTP exception thrown: Instance d211a2b0-7991-46ac-9231-06e79c90778a could not be found. Jun 29 08:17:38.451155 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-d20ff7d3-eeb9-44e1-8d1d-a91edf91bfaf tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Request method failure captured: Jun 29 08:17:38.451155 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: request: GET /compute/v2.1/servers/d211a2b0-7991-46ac-9231-06e79c90778a HTTP/1.1 Jun 29 08:17:38.451155 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: Accept: application/json Jun 29 08:17:38.451155 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: Accept-Encoding: identity Jun 29 08:17:38.451155 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: Connection: close Jun 29 08:17:38.451155 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: Content-Length: 0 Jun 29 08:17:38.451155 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: Content-Type: application/json Jun 29 08:17:38.451155 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: Host: 10.222.0.43 Jun 29 08:17:38.451155 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: Openstack-System-Scope: None Jun 29 08:17:38.451155 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: User-Agent: python-urllib3/1.26.9 Jun 29 08:17:38.451155 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Auth-Token: gAAAAABivAoGY6uFi1ES8uYciUsYTi7e52XuVlKhKZ-pFuhsbIEMlIAnzWczEIhBVXzUy7PhTY6OsMmCGfi12PcK94PKpbbtc8hj_Mq_nsegxtyMlT1nNFJwLDSaLzX82lKEfy_vfWjud_qiJ7hLMlzsopelkHH0uijVjdtkQbKXpLTAoR0DKrs Jun 29 08:17:38.451155 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Domain-Id: None Jun 29 08:17:38.451155 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Domain-Name: None Jun 29 08:17:38.451155 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Identity-Status: Confirmed Jun 29 08:17:38.451155 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Is-Admin-Project: True Jun 29 08:17:38.451155 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Project-Domain-Id: default Jun 29 08:17:38.451155 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Project-Domain-Name: Default Jun 29 08:17:38.451155 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Project-Id: 1d0c865636434569b3e25362dc02d5b8 Jun 29 08:17:38.451155 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Project-Name: tempest-TestVolumeBootPattern-1408846588 Jun 29 08:17:38.451155 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Role: member,reader Jun 29 08:17:38.451155 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Roles: member,reader Jun 29 08:17:38.453107 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/1d0c865636434569b3e25362dc02d5b8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_1d0c865636434569b3e25362dc02d5b8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/1d0c865636434569b3e25362dc02d5b8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/1d0c865636434569b3e25362dc02d5b8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Jun 29 08:17:38.453107 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Tenant: tempest-TestVolumeBootPattern-1408846588 Jun 29 08:17:38.453107 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Tenant-Id: 1d0c865636434569b3e25362dc02d5b8 Jun 29 08:17:38.453107 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Tenant-Name: tempest-TestVolumeBootPattern-1408846588 Jun 29 08:17:38.453107 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-User: tempest-TestVolumeBootPattern-1408846588-project Jun 29 08:17:38.453107 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-User-Domain-Id: default Jun 29 08:17:38.453107 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-User-Domain-Name: Default Jun 29 08:17:38.453107 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-User-Id: 36fcd3d9c490413ab9429bccdad444cb Jun 29 08:17:38.453107 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-User-Name: tempest-TestVolumeBootPattern-1408846588-project Jun 29 08:17:38.453107 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: method: > Jun 29 08:17:38.453107 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: exception: Instance d211a2b0-7991-46ac-9231-06e79c90778a could not be found. Jun 29 08:17:38.453107 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: action_args: {'id': 'd211a2b0-7991-46ac-9231-06e79c90778a'} Jun 29 08:17:38.454001 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 08:17:38.454001 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:17:38.454001 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 29 08:17:38.454001 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 29 08:17:38.454001 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 29 08:17:38.454001 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 29 08:17:38.454001 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 29 08:17:38.454001 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 29 08:17:38.454001 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 29 08:17:38.454001 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 29 08:17:38.454001 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d211a2b0-7991-46ac-9231-06e79c90778a could not be found. Jun 29 08:17:38.454001 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 29 08:17:38.454001 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 08:17:38.454001 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 29 08:17:38.454001 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:17:38.454001 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 08:17:38.454001 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 08:17:38.454001 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 08:17:38.454001 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 08:17:38.454001 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 08:17:38.455599 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 08:17:38.455599 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 29 08:17:38.455599 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 29 08:17:38.455599 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 29 08:17:38.455599 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 29 08:17:38.455599 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 29 08:17:38.455599 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 29 08:17:38.455599 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d211a2b0-7991-46ac-9231-06e79c90778a could not be found. Jun 29 08:17:38.455599 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 29 08:17:38.455599 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 08:17:38.455599 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 29 08:17:38.455599 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:17:38.455599 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 08:17:38.455599 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 08:17:38.455599 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 08:17:38.455599 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 08:17:38.455599 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d211a2b0-7991-46ac-9231-06e79c90778a could not be found. Jun 29 08:17:38.455599 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 29 08:17:38.457346 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-d20ff7d3-eeb9-44e1-8d1d-a91edf91bfaf tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Returning 404 to user: Instance d211a2b0-7991-46ac-9231-06e79c90778a could not be found. {{(pid=117890) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 08:17:38.457346 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-d20ff7d3-eeb9-44e1-8d1d-a91edf91bfaf tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] 10.222.0.43 "GET /compute/v2.1/servers/d211a2b0-7991-46ac-9231-06e79c90778a" status: 404 len: 111 microversion: 2.1 time: 0.030246 Jun 29 08:17:38.457346 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 507/1022] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:17:38 2022] GET /compute/v2.1/servers/d211a2b0-7991-46ac-9231-06e79c90778a => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 29 08:17:38.503452 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-c79d4858-dec5-4969-ba9d-f1099bf4be4f tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1208735677", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-2054109478", "security_groups": [{"name": "tempest-secgroup-smoke-795901347"}], "block_device_mapping_v2": [{"uuid": "277f1630-1dc3-45ad-bb54-48a27eaec124", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "4f989f48-15ed-4255-b1c5-b3741c687df0"}]}} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:17:38.615062 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.network.neutron [None req-c79d4858-dec5-4969-ba9d-f1099bf4be4f tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] validate_networks() for [('4f989f48-15ed-4255-b1c5-b3741c687df0', None, None, None, None, None)] {{(pid=117889) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 29 08:17:38.989107 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.virt.hardware [None req-c79d4858-dec5-4969-ba9d-f1099bf4be4f tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Flavor limits 0:0:0 {{(pid=117889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 29 08:17:38.989852 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.virt.hardware [None req-c79d4858-dec5-4969-ba9d-f1099bf4be4f tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Image limits 0:0:0 {{(pid=117889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 29 08:17:38.990692 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.virt.hardware [None req-c79d4858-dec5-4969-ba9d-f1099bf4be4f tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Flavor pref 0:0:0 {{(pid=117889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 29 08:17:38.991391 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.virt.hardware [None req-c79d4858-dec5-4969-ba9d-f1099bf4be4f tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Image pref 0:0:0 {{(pid=117889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 29 08:17:38.992097 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.virt.hardware [None req-c79d4858-dec5-4969-ba9d-f1099bf4be4f tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117889) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 29 08:17:39.006251 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c79d4858-dec5-4969-ba9d-f1099bf4be4f tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:17:39.008567 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c79d4858-dec5-4969-ba9d-f1099bf4be4f tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:17:39.008567 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c79d4858-dec5-4969-ba9d-f1099bf4be4f tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:17:39.008567 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-c79d4858-dec5-4969-ba9d-f1099bf4be4f tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:17:39.036360 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.quota [None req-c79d4858-dec5-4969-ba9d-f1099bf4be4f tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Getting quotas for project 1d0c865636434569b3e25362dc02d5b8. Resources: {'ram', 'instances', 'cores'} {{(pid=117889) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 29 08:17:39.040354 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.quota [None req-c79d4858-dec5-4969-ba9d-f1099bf4be4f tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Getting quotas for user 36fcd3d9c490413ab9429bccdad444cb and project 1d0c865636434569b3e25362dc02d5b8. Resources: {'ram', 'instances', 'cores'} {{(pid=117889) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 29 08:17:39.097581 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-c79d4858-dec5-4969-ba9d-f1099bf4be4f tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Going to run 1 instances... {{(pid=117889) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 29 08:17:39.099753 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-c79d4858-dec5-4969-ba9d-f1099bf4be4f tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] [instance: 13ef577f-d316-4519-8503-5817813a3d6b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='277f1630-1dc3-45ad-bb54-48a27eaec124',volume_size=None,volume_type=None)] {{(pid=117889) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 29 08:17:39.236068 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-c79d4858-dec5-4969-ba9d-f1099bf4be4f tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.737093 Jun 29 08:17:39.236627 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 516/1023] 10.222.0.43 () {60 vars in 1146 bytes} [Wed Jun 29 08:17:38 2022] POST /compute/v2.1/servers => generated 405 bytes in 739 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 29 08:17:39.246613 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-a78e65e4-df86-42ba-bc44-87760bea0edf tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:17:39.247257 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-a78e65e4-df86-42ba-bc44-87760bea0edf tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] [instance: 13ef577f-d316-4519-8503-5817813a3d6b] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:17:39.305790 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-a78e65e4-df86-42ba-bc44-87760bea0edf tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36fcd3d9c490413ab9429bccdad444cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d0c865636434569b3e25362dc02d5b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:17:39.313303 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-a78e65e4-df86-42ba-bc44-87760bea0edf tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] 10.222.0.43 "GET /compute/v2.1/servers/13ef577f-d316-4519-8503-5817813a3d6b" status: 200 len: 1095 microversion: 2.1 time: 0.070530 Jun 29 08:17:39.313915 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 508/1024] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:17:39 2022] GET /compute/v2.1/servers/13ef577f-d316-4519-8503-5817813a3d6b => generated 1095 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:17:40.331014 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-b0e05dd3-43de-41ae-be56-b12467e5e318 tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:17:40.331643 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-b0e05dd3-43de-41ae-be56-b12467e5e318 tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] [instance: 13ef577f-d316-4519-8503-5817813a3d6b] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:17:40.338596 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-b0e05dd3-43de-41ae-be56-b12467e5e318 tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:17:40.339053 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-b0e05dd3-43de-41ae-be56-b12467e5e318 tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:17:40.339835 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-b0e05dd3-43de-41ae-be56-b12467e5e318 tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:17:40.340284 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-b0e05dd3-43de-41ae-be56-b12467e5e318 tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:17:40.408071 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-b0e05dd3-43de-41ae-be56-b12467e5e318 tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36fcd3d9c490413ab9429bccdad444cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d0c865636434569b3e25362dc02d5b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:17:40.415552 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-b0e05dd3-43de-41ae-be56-b12467e5e318 tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] 10.222.0.43 "GET /compute/v2.1/servers/13ef577f-d316-4519-8503-5817813a3d6b" status: 200 len: 1211 microversion: 2.1 time: 0.089084 Jun 29 08:17:40.416115 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 517/1025] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:17:40 2022] GET /compute/v2.1/servers/13ef577f-d316-4519-8503-5817813a3d6b => generated 1211 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:17:41.432842 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-7f141fa3-1386-485b-b966-b2595484770b tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:17:41.433659 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-7f141fa3-1386-485b-b966-b2595484770b tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] [instance: 13ef577f-d316-4519-8503-5817813a3d6b] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:17:41.442570 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-7f141fa3-1386-485b-b966-b2595484770b tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:17:41.443163 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-7f141fa3-1386-485b-b966-b2595484770b tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:17:41.444044 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-7f141fa3-1386-485b-b966-b2595484770b tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:17:41.444604 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-7f141fa3-1386-485b-b966-b2595484770b tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:17:41.657057 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-7f141fa3-1386-485b-b966-b2595484770b tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36fcd3d9c490413ab9429bccdad444cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d0c865636434569b3e25362dc02d5b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:17:41.666106 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-7f141fa3-1386-485b-b966-b2595484770b tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] 10.222.0.43 "GET /compute/v2.1/servers/13ef577f-d316-4519-8503-5817813a3d6b" status: 200 len: 1266 microversion: 2.1 time: 0.237395 Jun 29 08:17:41.666888 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 509/1026] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:17:41 2022] GET /compute/v2.1/servers/13ef577f-d316-4519-8503-5817813a3d6b => generated 1266 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:17:41.686211 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [req-6d9cf4bc-8dd7-46f7-a7e5-08b3c60fc75d req-cc261ffb-91bf-41cb-bdd7-ed7b4e9d7671 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "13ef577f-d316-4519-8503-5817813a3d6b", "tag": "f9a0dbb5-9271-4850-a567-692f86b3599e"}]} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:17:41.697466 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-6d9cf4bc-8dd7-46f7-a7e5-08b3c60fc75d req-cc261ffb-91bf-41cb-bdd7-ed7b4e9d7671 service nova] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:17:41.697926 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-6d9cf4bc-8dd7-46f7-a7e5-08b3c60fc75d req-cc261ffb-91bf-41cb-bdd7-ed7b4e9d7671 service nova] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:17:41.714218 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.compute.server_external_events [req-6d9cf4bc-8dd7-46f7-a7e5-08b3c60fc75d req-cc261ffb-91bf-41cb-bdd7-ed7b4e9d7671 service nova] Creating event network-changed:f9a0dbb5-9271-4850-a567-692f86b3599e for instance 13ef577f-d316-4519-8503-5817813a3d6b on hv-cinder-76810 Jun 29 08:17:41.720437 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [req-6d9cf4bc-8dd7-46f7-a7e5-08b3c60fc75d req-cc261ffb-91bf-41cb-bdd7-ed7b4e9d7671 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042587 Jun 29 08:17:41.721829 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 518/1027] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jun 29 08:17:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:17:42.685294 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-a1daa811-239a-452f-aa16-b0498ec937d7 tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:17:42.685968 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-a1daa811-239a-452f-aa16-b0498ec937d7 tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] [instance: 13ef577f-d316-4519-8503-5817813a3d6b] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:17:42.693340 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-a1daa811-239a-452f-aa16-b0498ec937d7 tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:17:42.693805 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-a1daa811-239a-452f-aa16-b0498ec937d7 tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:17:42.694589 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-a1daa811-239a-452f-aa16-b0498ec937d7 tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:17:42.695033 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-a1daa811-239a-452f-aa16-b0498ec937d7 tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:17:42.913618 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-a1daa811-239a-452f-aa16-b0498ec937d7 tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36fcd3d9c490413ab9429bccdad444cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d0c865636434569b3e25362dc02d5b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:17:42.921823 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-a1daa811-239a-452f-aa16-b0498ec937d7 tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] 10.222.0.43 "GET /compute/v2.1/servers/13ef577f-d316-4519-8503-5817813a3d6b" status: 200 len: 1266 microversion: 2.1 time: 0.240134 Jun 29 08:17:42.922386 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 510/1028] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:17:42 2022] GET /compute/v2.1/servers/13ef577f-d316-4519-8503-5817813a3d6b => generated 1266 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:17:43.940588 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-a4640282-bef9-4955-8c1c-82ba66e34c49 tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:17:43.941319 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-a4640282-bef9-4955-8c1c-82ba66e34c49 tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] [instance: 13ef577f-d316-4519-8503-5817813a3d6b] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:17:43.947499 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-a4640282-bef9-4955-8c1c-82ba66e34c49 tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:17:43.947951 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-a4640282-bef9-4955-8c1c-82ba66e34c49 tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:17:43.948713 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-a4640282-bef9-4955-8c1c-82ba66e34c49 tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:17:43.949184 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-a4640282-bef9-4955-8c1c-82ba66e34c49 tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:17:44.085196 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-a4640282-bef9-4955-8c1c-82ba66e34c49 tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36fcd3d9c490413ab9429bccdad444cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d0c865636434569b3e25362dc02d5b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:17:44.092777 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-a4640282-bef9-4955-8c1c-82ba66e34c49 tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] 10.222.0.43 "GET /compute/v2.1/servers/13ef577f-d316-4519-8503-5817813a3d6b" status: 200 len: 1266 microversion: 2.1 time: 0.157279 Jun 29 08:17:44.093832 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 519/1029] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:17:43 2022] GET /compute/v2.1/servers/13ef577f-d316-4519-8503-5817813a3d6b => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 29 08:17:45.109568 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-3ed96259-e2a0-43a4-b649-3ad7dc075a99 tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:17:45.110195 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-3ed96259-e2a0-43a4-b649-3ad7dc075a99 tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] [instance: 13ef577f-d316-4519-8503-5817813a3d6b] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:17:45.116821 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-3ed96259-e2a0-43a4-b649-3ad7dc075a99 tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:17:45.117300 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-3ed96259-e2a0-43a4-b649-3ad7dc075a99 tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:17:45.118067 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-3ed96259-e2a0-43a4-b649-3ad7dc075a99 tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:17:45.118509 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-3ed96259-e2a0-43a4-b649-3ad7dc075a99 tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:17:45.517385 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-3ed96259-e2a0-43a4-b649-3ad7dc075a99 tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36fcd3d9c490413ab9429bccdad444cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d0c865636434569b3e25362dc02d5b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:17:45.525238 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-3ed96259-e2a0-43a4-b649-3ad7dc075a99 tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] 10.222.0.43 "GET /compute/v2.1/servers/13ef577f-d316-4519-8503-5817813a3d6b" status: 200 len: 1266 microversion: 2.1 time: 0.419752 Jun 29 08:17:45.525814 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 511/1030] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:17:45 2022] GET /compute/v2.1/servers/13ef577f-d316-4519-8503-5817813a3d6b => generated 1266 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:17:46.543484 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-b6b99230-bf67-4478-ae88-5a0d5fb4f890 tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:17:46.544110 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-b6b99230-bf67-4478-ae88-5a0d5fb4f890 tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] [instance: 13ef577f-d316-4519-8503-5817813a3d6b] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:17:46.550930 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-b6b99230-bf67-4478-ae88-5a0d5fb4f890 tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:17:46.551387 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-b6b99230-bf67-4478-ae88-5a0d5fb4f890 tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:17:46.552160 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-b6b99230-bf67-4478-ae88-5a0d5fb4f890 tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:17:46.552605 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-b6b99230-bf67-4478-ae88-5a0d5fb4f890 tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:17:46.927400 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-b6b99230-bf67-4478-ae88-5a0d5fb4f890 tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36fcd3d9c490413ab9429bccdad444cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d0c865636434569b3e25362dc02d5b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:17:46.935064 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-b6b99230-bf67-4478-ae88-5a0d5fb4f890 tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] 10.222.0.43 "GET /compute/v2.1/servers/13ef577f-d316-4519-8503-5817813a3d6b" status: 200 len: 1266 microversion: 2.1 time: 0.395520 Jun 29 08:17:46.935627 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 520/1031] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:17:46 2022] GET /compute/v2.1/servers/13ef577f-d316-4519-8503-5817813a3d6b => generated 1266 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:17:47.951550 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-3d8690b2-25e1-48c9-a7a6-49b5f8cb2db3 tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:17:47.952601 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-3d8690b2-25e1-48c9-a7a6-49b5f8cb2db3 tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] [instance: 13ef577f-d316-4519-8503-5817813a3d6b] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:17:47.959229 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-3d8690b2-25e1-48c9-a7a6-49b5f8cb2db3 tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:17:47.959703 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-3d8690b2-25e1-48c9-a7a6-49b5f8cb2db3 tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:17:47.960442 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-3d8690b2-25e1-48c9-a7a6-49b5f8cb2db3 tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:17:47.960874 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-3d8690b2-25e1-48c9-a7a6-49b5f8cb2db3 tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:17:48.090214 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-3d8690b2-25e1-48c9-a7a6-49b5f8cb2db3 tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36fcd3d9c490413ab9429bccdad444cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d0c865636434569b3e25362dc02d5b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:17:48.098272 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-3d8690b2-25e1-48c9-a7a6-49b5f8cb2db3 tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] 10.222.0.43 "GET /compute/v2.1/servers/13ef577f-d316-4519-8503-5817813a3d6b" status: 200 len: 1266 microversion: 2.1 time: 0.150655 Jun 29 08:17:48.098838 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 512/1032] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:17:47 2022] GET /compute/v2.1/servers/13ef577f-d316-4519-8503-5817813a3d6b => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:17:49.115507 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-beb4de68-7476-4c33-b62a-9e95594ca5f8 tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:17:49.116128 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-beb4de68-7476-4c33-b62a-9e95594ca5f8 tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] [instance: 13ef577f-d316-4519-8503-5817813a3d6b] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:17:49.118550 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_cell0:SELECT=2 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:17:49.119297 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_cell0:SELECT=6 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:17:49.126112 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-beb4de68-7476-4c33-b62a-9e95594ca5f8 tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:17:49.126558 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-beb4de68-7476-4c33-b62a-9e95594ca5f8 tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:17:49.127329 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-beb4de68-7476-4c33-b62a-9e95594ca5f8 tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:17:49.127766 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-beb4de68-7476-4c33-b62a-9e95594ca5f8 tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:17:49.257281 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-beb4de68-7476-4c33-b62a-9e95594ca5f8 tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36fcd3d9c490413ab9429bccdad444cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d0c865636434569b3e25362dc02d5b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:17:49.265543 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-beb4de68-7476-4c33-b62a-9e95594ca5f8 tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] 10.222.0.43 "GET /compute/v2.1/servers/13ef577f-d316-4519-8503-5817813a3d6b" status: 200 len: 1266 microversion: 2.1 time: 0.153989 Jun 29 08:17:49.266126 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 521/1033] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:17:49 2022] GET /compute/v2.1/servers/13ef577f-d316-4519-8503-5817813a3d6b => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:17:50.282913 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-d11260b0-9798-4074-99f7-6b21d0b3be49 tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:17:50.283519 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-d11260b0-9798-4074-99f7-6b21d0b3be49 tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] [instance: 13ef577f-d316-4519-8503-5817813a3d6b] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:17:50.285874 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG dbcounter [-] [117890] Writing DB stats nova_cell0:SELECT=2 {{(pid=117890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:17:50.291287 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-d11260b0-9798-4074-99f7-6b21d0b3be49 tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:17:50.291733 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-d11260b0-9798-4074-99f7-6b21d0b3be49 tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:17:50.292491 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-d11260b0-9798-4074-99f7-6b21d0b3be49 tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:17:50.292921 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-d11260b0-9798-4074-99f7-6b21d0b3be49 tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:17:50.427279 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-d11260b0-9798-4074-99f7-6b21d0b3be49 tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36fcd3d9c490413ab9429bccdad444cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d0c865636434569b3e25362dc02d5b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:17:50.434914 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-d11260b0-9798-4074-99f7-6b21d0b3be49 tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] 10.222.0.43 "GET /compute/v2.1/servers/13ef577f-d316-4519-8503-5817813a3d6b" status: 200 len: 1266 microversion: 2.1 time: 0.156519 Jun 29 08:17:50.435463 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 513/1034] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:17:50 2022] GET /compute/v2.1/servers/13ef577f-d316-4519-8503-5817813a3d6b => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:17:51.450928 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-014652b2-70e8-454c-9117-68d42a08c799 tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:17:51.451652 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-014652b2-70e8-454c-9117-68d42a08c799 tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] [instance: 13ef577f-d316-4519-8503-5817813a3d6b] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:17:51.459018 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-014652b2-70e8-454c-9117-68d42a08c799 tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:17:51.459468 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-014652b2-70e8-454c-9117-68d42a08c799 tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:17:51.460244 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-014652b2-70e8-454c-9117-68d42a08c799 tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:17:51.460684 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-014652b2-70e8-454c-9117-68d42a08c799 tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:17:51.595534 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-014652b2-70e8-454c-9117-68d42a08c799 tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36fcd3d9c490413ab9429bccdad444cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d0c865636434569b3e25362dc02d5b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:17:51.603060 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-014652b2-70e8-454c-9117-68d42a08c799 tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] 10.222.0.43 "GET /compute/v2.1/servers/13ef577f-d316-4519-8503-5817813a3d6b" status: 200 len: 1266 microversion: 2.1 time: 0.156043 Jun 29 08:17:51.603625 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 522/1035] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:17:51 2022] GET /compute/v2.1/servers/13ef577f-d316-4519-8503-5817813a3d6b => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:17:52.619837 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-ec51ea6b-bb78-4c12-8f6f-bf69e413d4b8 tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:17:52.620448 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-ec51ea6b-bb78-4c12-8f6f-bf69e413d4b8 tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] [instance: 13ef577f-d316-4519-8503-5817813a3d6b] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:17:52.628109 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-ec51ea6b-bb78-4c12-8f6f-bf69e413d4b8 tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:17:52.628554 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-ec51ea6b-bb78-4c12-8f6f-bf69e413d4b8 tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:17:52.629359 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-ec51ea6b-bb78-4c12-8f6f-bf69e413d4b8 tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:17:52.629801 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-ec51ea6b-bb78-4c12-8f6f-bf69e413d4b8 tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:17:52.764821 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-ec51ea6b-bb78-4c12-8f6f-bf69e413d4b8 tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36fcd3d9c490413ab9429bccdad444cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d0c865636434569b3e25362dc02d5b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:17:52.772320 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-ec51ea6b-bb78-4c12-8f6f-bf69e413d4b8 tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] 10.222.0.43 "GET /compute/v2.1/servers/13ef577f-d316-4519-8503-5817813a3d6b" status: 200 len: 1266 microversion: 2.1 time: 0.156344 Jun 29 08:17:52.772893 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 514/1036] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:17:52 2022] GET /compute/v2.1/servers/13ef577f-d316-4519-8503-5817813a3d6b => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:17:52.953270 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [req-03fb7225-14ba-4477-8197-3bc2b5a3d262 req-cffb59ad-0393-4fcc-9053-d61836da901d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13ef577f-d316-4519-8503-5817813a3d6b", "name": "network-vif-plugged", "status": "completed", "tag": "f9a0dbb5-9271-4850-a567-692f86b3599e"}]} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:17:52.964236 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-03fb7225-14ba-4477-8197-3bc2b5a3d262 req-cffb59ad-0393-4fcc-9053-d61836da901d service nova] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:17:52.965062 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-03fb7225-14ba-4477-8197-3bc2b5a3d262 req-cffb59ad-0393-4fcc-9053-d61836da901d service nova] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:17:52.987723 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.compute.server_external_events [req-03fb7225-14ba-4477-8197-3bc2b5a3d262 req-cffb59ad-0393-4fcc-9053-d61836da901d service nova] Creating event network-vif-plugged:f9a0dbb5-9271-4850-a567-692f86b3599e for instance 13ef577f-d316-4519-8503-5817813a3d6b on hv-cinder-76810 Jun 29 08:17:52.996363 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [req-03fb7225-14ba-4477-8197-3bc2b5a3d262 req-cffb59ad-0393-4fcc-9053-d61836da901d service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046596 Jun 29 08:17:52.997509 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 523/1037] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jun 29 08:17:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:17:53.790058 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-823835a4-a1a5-4c0b-8999-e4d1c719bddf tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:17:53.790664 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-823835a4-a1a5-4c0b-8999-e4d1c719bddf tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] [instance: 13ef577f-d316-4519-8503-5817813a3d6b] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:17:53.798247 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-823835a4-a1a5-4c0b-8999-e4d1c719bddf tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:17:53.798822 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-823835a4-a1a5-4c0b-8999-e4d1c719bddf tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:17:53.799482 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-823835a4-a1a5-4c0b-8999-e4d1c719bddf tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:17:53.799919 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-823835a4-a1a5-4c0b-8999-e4d1c719bddf tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:17:53.934244 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-823835a4-a1a5-4c0b-8999-e4d1c719bddf tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36fcd3d9c490413ab9429bccdad444cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d0c865636434569b3e25362dc02d5b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:17:53.942071 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-823835a4-a1a5-4c0b-8999-e4d1c719bddf tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] 10.222.0.43 "GET /compute/v2.1/servers/13ef577f-d316-4519-8503-5817813a3d6b" status: 200 len: 1266 microversion: 2.1 time: 0.155957 Jun 29 08:17:53.942640 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 515/1038] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:17:53 2022] GET /compute/v2.1/servers/13ef577f-d316-4519-8503-5817813a3d6b => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:17:54.960111 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-01c39c05-2312-4f4f-b77e-8fab5c529aa0 tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:17:54.960804 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-01c39c05-2312-4f4f-b77e-8fab5c529aa0 tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] [instance: 13ef577f-d316-4519-8503-5817813a3d6b] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:17:54.969372 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-01c39c05-2312-4f4f-b77e-8fab5c529aa0 tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:17:54.969766 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-01c39c05-2312-4f4f-b77e-8fab5c529aa0 tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:17:54.970527 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-01c39c05-2312-4f4f-b77e-8fab5c529aa0 tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:17:54.970962 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-01c39c05-2312-4f4f-b77e-8fab5c529aa0 tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:17:55.105733 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-01c39c05-2312-4f4f-b77e-8fab5c529aa0 tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36fcd3d9c490413ab9429bccdad444cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d0c865636434569b3e25362dc02d5b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:17:55.114030 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-01c39c05-2312-4f4f-b77e-8fab5c529aa0 tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] 10.222.0.43 "GET /compute/v2.1/servers/13ef577f-d316-4519-8503-5817813a3d6b" status: 200 len: 1453 microversion: 2.1 time: 0.159019 Jun 29 08:17:55.114813 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 524/1039] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:17:54 2022] GET /compute/v2.1/servers/13ef577f-d316-4519-8503-5817813a3d6b => generated 1453 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:17:55.135480 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-740d5e80-5c53-4b07-9ba0-0f8f9d14c07d tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:17:55.136810 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-740d5e80-5c53-4b07-9ba0-0f8f9d14c07d tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] [instance: 13ef577f-d316-4519-8503-5817813a3d6b] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:17:55.144277 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-740d5e80-5c53-4b07-9ba0-0f8f9d14c07d tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:17:55.144811 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-740d5e80-5c53-4b07-9ba0-0f8f9d14c07d tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:17:55.145687 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-740d5e80-5c53-4b07-9ba0-0f8f9d14c07d tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:17:55.146179 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-740d5e80-5c53-4b07-9ba0-0f8f9d14c07d tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:17:55.281943 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-740d5e80-5c53-4b07-9ba0-0f8f9d14c07d tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36fcd3d9c490413ab9429bccdad444cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d0c865636434569b3e25362dc02d5b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:17:55.289678 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-740d5e80-5c53-4b07-9ba0-0f8f9d14c07d tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] 10.222.0.43 "GET /compute/v2.1/servers/13ef577f-d316-4519-8503-5817813a3d6b" status: 200 len: 1453 microversion: 2.1 time: 0.159420 Jun 29 08:17:55.290246 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 516/1040] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:17:55 2022] GET /compute/v2.1/servers/13ef577f-d316-4519-8503-5817813a3d6b => generated 1453 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:17:56.903980 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [req-8d1c661d-ceaa-4f2b-9d7f-a3babc9a608e req-1eb2a86d-bd97-418f-855a-8b4e923b828e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "13ef577f-d316-4519-8503-5817813a3d6b", "tag": "f9a0dbb5-9271-4850-a567-692f86b3599e"}]} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:17:56.913433 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-8d1c661d-ceaa-4f2b-9d7f-a3babc9a608e req-1eb2a86d-bd97-418f-855a-8b4e923b828e service nova] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:17:56.913877 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-8d1c661d-ceaa-4f2b-9d7f-a3babc9a608e req-1eb2a86d-bd97-418f-855a-8b4e923b828e service nova] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:17:56.926601 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.compute.server_external_events [req-8d1c661d-ceaa-4f2b-9d7f-a3babc9a608e req-1eb2a86d-bd97-418f-855a-8b4e923b828e service nova] Creating event network-changed:f9a0dbb5-9271-4850-a567-692f86b3599e for instance 13ef577f-d316-4519-8503-5817813a3d6b on hv-cinder-76810 Jun 29 08:17:56.932150 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [req-8d1c661d-ceaa-4f2b-9d7f-a3babc9a608e req-1eb2a86d-bd97-418f-855a-8b4e923b828e service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031836 Jun 29 08:17:56.933148 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 525/1041] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jun 29 08:17:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:17:59.541821 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 29 08:17:59.542403 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: Wed Jun 29 08:17:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 29 08:17:59.668026 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 29 08:17:59.668635 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: Wed Jun 29 08:17:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 29 08:18:05.093711 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 29 08:18:05.094376 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: Wed Jun 29 08:18:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 29 08:18:26.747218 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 29 08:18:26.747734 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: Wed Jun 29 08:18:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 29 08:19:29.882037 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG dbcounter [-] [117890] Writing DB stats nova_api:SELECT=26 {{(pid=117890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:19:29.883594 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG dbcounter [-] [117890] Writing DB stats nova_cell1:SELECT=62 {{(pid=117890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:19:29.887660 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-3a96b7a8-ce92-4632-8c25-867bb468ea44 tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1863500165", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-2054109478", "security_groups": [{"name": "tempest-secgroup-smoke-795901347"}], "block_device_mapping_v2": [{"uuid": "6b9d65ab-8e88-4b77-bef7-3d393bf69101", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "4f989f48-15ed-4255-b1c5-b3741c687df0"}]}} {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:19:30.124421 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.network.neutron [None req-3a96b7a8-ce92-4632-8c25-867bb468ea44 tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] validate_networks() for [('4f989f48-15ed-4255-b1c5-b3741c687df0', None, None, None, None, None)] {{(pid=117890) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 29 08:19:30.586427 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.virt.hardware [None req-3a96b7a8-ce92-4632-8c25-867bb468ea44 tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Flavor limits 0:0:0 {{(pid=117890) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 29 08:19:30.586856 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.virt.hardware [None req-3a96b7a8-ce92-4632-8c25-867bb468ea44 tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Image limits 0:0:0 {{(pid=117890) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 29 08:19:30.587332 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.virt.hardware [None req-3a96b7a8-ce92-4632-8c25-867bb468ea44 tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Flavor pref 0:0:0 {{(pid=117890) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 29 08:19:30.587746 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.virt.hardware [None req-3a96b7a8-ce92-4632-8c25-867bb468ea44 tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Image pref 0:0:0 {{(pid=117890) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 29 08:19:30.588182 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.virt.hardware [None req-3a96b7a8-ce92-4632-8c25-867bb468ea44 tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117890) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 29 08:19:30.597047 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-3a96b7a8-ce92-4632-8c25-867bb468ea44 tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:19:30.597497 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-3a96b7a8-ce92-4632-8c25-867bb468ea44 tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:19:30.598296 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-3a96b7a8-ce92-4632-8c25-867bb468ea44 tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:19:30.598733 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-3a96b7a8-ce92-4632-8c25-867bb468ea44 tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:19:30.615749 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.quota [None req-3a96b7a8-ce92-4632-8c25-867bb468ea44 tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Getting quotas for project 1d0c865636434569b3e25362dc02d5b8. Resources: {'ram', 'instances', 'cores'} {{(pid=117890) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 29 08:19:30.619661 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.quota [None req-3a96b7a8-ce92-4632-8c25-867bb468ea44 tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Getting quotas for user 36fcd3d9c490413ab9429bccdad444cb and project 1d0c865636434569b3e25362dc02d5b8. Resources: {'ram', 'instances', 'cores'} {{(pid=117890) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 29 08:19:30.677308 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-3a96b7a8-ce92-4632-8c25-867bb468ea44 tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Going to run 1 instances... {{(pid=117890) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 29 08:19:30.679370 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-3a96b7a8-ce92-4632-8c25-867bb468ea44 tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] [instance: 0ea2e9da-6298-4fff-9acc-1b2777314b79] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='6b9d65ab-8e88-4b77-bef7-3d393bf69101',volume_size=None,volume_type=None)] {{(pid=117890) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 29 08:19:30.812227 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-3a96b7a8-ce92-4632-8c25-867bb468ea44 tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.932083 Jun 29 08:19:30.812875 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 517/1042] 10.222.0.43 () {60 vars in 1146 bytes} [Wed Jun 29 08:19:29 2022] POST /compute/v2.1/servers => generated 405 bytes in 933 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 29 08:19:30.821553 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:19:30.822288 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_cell1:SELECT=66,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:19:30.826936 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-17f5f7e8-4c9d-4f10-8eb0-ef051084e7f4 tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:19:30.827740 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-17f5f7e8-4c9d-4f10-8eb0-ef051084e7f4 tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] [instance: 0ea2e9da-6298-4fff-9acc-1b2777314b79] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:19:30.948314 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-17f5f7e8-4c9d-4f10-8eb0-ef051084e7f4 tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36fcd3d9c490413ab9429bccdad444cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d0c865636434569b3e25362dc02d5b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:19:30.955694 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-17f5f7e8-4c9d-4f10-8eb0-ef051084e7f4 tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] 10.222.0.43 "GET /compute/v2.1/servers/0ea2e9da-6298-4fff-9acc-1b2777314b79" status: 200 len: 1095 microversion: 2.1 time: 0.136228 Jun 29 08:19:30.957046 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 526/1043] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:19:30 2022] GET /compute/v2.1/servers/0ea2e9da-6298-4fff-9acc-1b2777314b79 => generated 1095 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:19:31.974831 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-215e1dfe-dac1-4c08-b8bf-62990d19a2bc tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:19:31.975449 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-215e1dfe-dac1-4c08-b8bf-62990d19a2bc tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] [instance: 0ea2e9da-6298-4fff-9acc-1b2777314b79] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:19:31.982113 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-215e1dfe-dac1-4c08-b8bf-62990d19a2bc tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:19:31.982408 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-215e1dfe-dac1-4c08-b8bf-62990d19a2bc tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:19:31.983421 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-215e1dfe-dac1-4c08-b8bf-62990d19a2bc tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:19:31.984080 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-215e1dfe-dac1-4c08-b8bf-62990d19a2bc tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:19:32.061596 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-215e1dfe-dac1-4c08-b8bf-62990d19a2bc tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36fcd3d9c490413ab9429bccdad444cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d0c865636434569b3e25362dc02d5b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:19:32.070371 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-215e1dfe-dac1-4c08-b8bf-62990d19a2bc tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] 10.222.0.43 "GET /compute/v2.1/servers/0ea2e9da-6298-4fff-9acc-1b2777314b79" status: 200 len: 1211 microversion: 2.1 time: 0.100338 Jun 29 08:19:32.070952 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 518/1044] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:19:31 2022] GET /compute/v2.1/servers/0ea2e9da-6298-4fff-9acc-1b2777314b79 => generated 1211 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:19:33.091546 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-b736b7a0-11d5-4db6-a62a-1fca36db5b75 tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:19:33.093008 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-b736b7a0-11d5-4db6-a62a-1fca36db5b75 tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] [instance: 0ea2e9da-6298-4fff-9acc-1b2777314b79] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:19:33.100632 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-b736b7a0-11d5-4db6-a62a-1fca36db5b75 tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:19:33.101218 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-b736b7a0-11d5-4db6-a62a-1fca36db5b75 tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:19:33.101969 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-b736b7a0-11d5-4db6-a62a-1fca36db5b75 tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:19:33.102560 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-b736b7a0-11d5-4db6-a62a-1fca36db5b75 tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:19:33.245486 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [req-590983d9-c875-4ba2-90fa-f8e06e3520a7 req-75bca3be-04a7-400a-b414-fa15dd3734e7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0ea2e9da-6298-4fff-9acc-1b2777314b79", "tag": "87c86cee-4821-4d39-868c-0bc1b50c262c"}]} {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:19:33.260736 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [req-590983d9-c875-4ba2-90fa-f8e06e3520a7 req-75bca3be-04a7-400a-b414-fa15dd3734e7 service nova] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:19:33.261568 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [req-590983d9-c875-4ba2-90fa-f8e06e3520a7 req-75bca3be-04a7-400a-b414-fa15dd3734e7 service nova] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:19:33.262779 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-b736b7a0-11d5-4db6-a62a-1fca36db5b75 tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36fcd3d9c490413ab9429bccdad444cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d0c865636434569b3e25362dc02d5b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:19:33.272543 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-b736b7a0-11d5-4db6-a62a-1fca36db5b75 tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] 10.222.0.43 "GET /compute/v2.1/servers/0ea2e9da-6298-4fff-9acc-1b2777314b79" status: 200 len: 1266 microversion: 2.1 time: 0.188139 Jun 29 08:19:33.274297 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 527/1045] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:19:33 2022] GET /compute/v2.1/servers/0ea2e9da-6298-4fff-9acc-1b2777314b79 => generated 1266 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:19:33.291030 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.compute.server_external_events [req-590983d9-c875-4ba2-90fa-f8e06e3520a7 req-75bca3be-04a7-400a-b414-fa15dd3734e7 service nova] Creating event network-changed:87c86cee-4821-4d39-868c-0bc1b50c262c for instance 0ea2e9da-6298-4fff-9acc-1b2777314b79 on hv-cinder-76810 Jun 29 08:19:33.297655 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [req-590983d9-c875-4ba2-90fa-f8e06e3520a7 req-75bca3be-04a7-400a-b414-fa15dd3734e7 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055671 Jun 29 08:19:33.298267 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 519/1046] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jun 29 08:19:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:19:34.291164 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-bd1ac345-e08f-4493-88be-5e7bafc8846a tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:19:34.291953 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-bd1ac345-e08f-4493-88be-5e7bafc8846a tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] [instance: 0ea2e9da-6298-4fff-9acc-1b2777314b79] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:19:34.298739 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-bd1ac345-e08f-4493-88be-5e7bafc8846a tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:19:34.299391 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-bd1ac345-e08f-4493-88be-5e7bafc8846a tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:19:34.300249 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-bd1ac345-e08f-4493-88be-5e7bafc8846a tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:19:34.300685 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-bd1ac345-e08f-4493-88be-5e7bafc8846a tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:19:34.436274 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-bd1ac345-e08f-4493-88be-5e7bafc8846a tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36fcd3d9c490413ab9429bccdad444cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d0c865636434569b3e25362dc02d5b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:19:34.444098 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-bd1ac345-e08f-4493-88be-5e7bafc8846a tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] 10.222.0.43 "GET /compute/v2.1/servers/0ea2e9da-6298-4fff-9acc-1b2777314b79" status: 200 len: 1266 microversion: 2.1 time: 0.156924 Jun 29 08:19:34.444683 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 528/1047] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:19:34 2022] GET /compute/v2.1/servers/0ea2e9da-6298-4fff-9acc-1b2777314b79 => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:19:35.460897 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-e3b38130-99ae-42c9-942c-811a163c2c65 tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:19:35.461625 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-e3b38130-99ae-42c9-942c-811a163c2c65 tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] [instance: 0ea2e9da-6298-4fff-9acc-1b2777314b79] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:19:35.467872 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-e3b38130-99ae-42c9-942c-811a163c2c65 tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:19:35.468316 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-e3b38130-99ae-42c9-942c-811a163c2c65 tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:19:35.469108 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-e3b38130-99ae-42c9-942c-811a163c2c65 tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:19:35.469542 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-e3b38130-99ae-42c9-942c-811a163c2c65 tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:19:35.613354 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-e3b38130-99ae-42c9-942c-811a163c2c65 tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36fcd3d9c490413ab9429bccdad444cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d0c865636434569b3e25362dc02d5b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:19:35.621264 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-e3b38130-99ae-42c9-942c-811a163c2c65 tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] 10.222.0.43 "GET /compute/v2.1/servers/0ea2e9da-6298-4fff-9acc-1b2777314b79" status: 200 len: 1266 microversion: 2.1 time: 0.164974 Jun 29 08:19:35.621837 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 520/1048] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:19:35 2022] GET /compute/v2.1/servers/0ea2e9da-6298-4fff-9acc-1b2777314b79 => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:19:36.638734 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-71151cea-a2b7-4641-be6c-97f9dada3e48 tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:19:36.639409 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-71151cea-a2b7-4641-be6c-97f9dada3e48 tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] [instance: 0ea2e9da-6298-4fff-9acc-1b2777314b79] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:19:36.646856 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-71151cea-a2b7-4641-be6c-97f9dada3e48 tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:19:36.647306 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-71151cea-a2b7-4641-be6c-97f9dada3e48 tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:19:36.648071 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-71151cea-a2b7-4641-be6c-97f9dada3e48 tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:19:36.648509 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-71151cea-a2b7-4641-be6c-97f9dada3e48 tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:19:36.775828 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-71151cea-a2b7-4641-be6c-97f9dada3e48 tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36fcd3d9c490413ab9429bccdad444cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d0c865636434569b3e25362dc02d5b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:19:36.783384 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-71151cea-a2b7-4641-be6c-97f9dada3e48 tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] 10.222.0.43 "GET /compute/v2.1/servers/0ea2e9da-6298-4fff-9acc-1b2777314b79" status: 200 len: 1266 microversion: 2.1 time: 0.148624 Jun 29 08:19:36.784602 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 529/1049] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:19:36 2022] GET /compute/v2.1/servers/0ea2e9da-6298-4fff-9acc-1b2777314b79 => generated 1266 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:19:37.801579 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-b4fbf0ec-496a-4e3b-bd8e-fb0c522ec0c1 tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:19:37.802193 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-b4fbf0ec-496a-4e3b-bd8e-fb0c522ec0c1 tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] [instance: 0ea2e9da-6298-4fff-9acc-1b2777314b79] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:19:37.808424 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-b4fbf0ec-496a-4e3b-bd8e-fb0c522ec0c1 tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:19:37.808875 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-b4fbf0ec-496a-4e3b-bd8e-fb0c522ec0c1 tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:19:37.809671 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-b4fbf0ec-496a-4e3b-bd8e-fb0c522ec0c1 tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:19:37.810111 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-b4fbf0ec-496a-4e3b-bd8e-fb0c522ec0c1 tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:19:37.947340 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-b4fbf0ec-496a-4e3b-bd8e-fb0c522ec0c1 tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36fcd3d9c490413ab9429bccdad444cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d0c865636434569b3e25362dc02d5b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:19:37.954726 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-b4fbf0ec-496a-4e3b-bd8e-fb0c522ec0c1 tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] 10.222.0.43 "GET /compute/v2.1/servers/0ea2e9da-6298-4fff-9acc-1b2777314b79" status: 200 len: 1266 microversion: 2.1 time: 0.158032 Jun 29 08:19:37.955931 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 521/1050] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:19:37 2022] GET /compute/v2.1/servers/0ea2e9da-6298-4fff-9acc-1b2777314b79 => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:19:38.972258 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-0605ce3f-7ec1-49d3-8fe4-65b026a88a1e tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:19:38.972992 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-0605ce3f-7ec1-49d3-8fe4-65b026a88a1e tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] [instance: 0ea2e9da-6298-4fff-9acc-1b2777314b79] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:19:38.979646 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-0605ce3f-7ec1-49d3-8fe4-65b026a88a1e tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:19:38.980117 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-0605ce3f-7ec1-49d3-8fe4-65b026a88a1e tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:19:38.980894 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-0605ce3f-7ec1-49d3-8fe4-65b026a88a1e tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:19:38.981359 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-0605ce3f-7ec1-49d3-8fe4-65b026a88a1e tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:19:39.122828 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-0605ce3f-7ec1-49d3-8fe4-65b026a88a1e tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36fcd3d9c490413ab9429bccdad444cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d0c865636434569b3e25362dc02d5b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:19:39.133042 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-0605ce3f-7ec1-49d3-8fe4-65b026a88a1e tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] 10.222.0.43 "GET /compute/v2.1/servers/0ea2e9da-6298-4fff-9acc-1b2777314b79" status: 200 len: 1266 microversion: 2.1 time: 0.165094 Jun 29 08:19:39.133639 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 530/1051] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:19:38 2022] GET /compute/v2.1/servers/0ea2e9da-6298-4fff-9acc-1b2777314b79 => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:19:40.150428 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-948b1988-d122-44c4-abd5-fb65b86e31b2 tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:19:40.151088 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-948b1988-d122-44c4-abd5-fb65b86e31b2 tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] [instance: 0ea2e9da-6298-4fff-9acc-1b2777314b79] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:19:40.157963 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-948b1988-d122-44c4-abd5-fb65b86e31b2 tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:19:40.158991 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-948b1988-d122-44c4-abd5-fb65b86e31b2 tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:19:40.159953 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-948b1988-d122-44c4-abd5-fb65b86e31b2 tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:19:40.160391 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-948b1988-d122-44c4-abd5-fb65b86e31b2 tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:19:40.302546 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-948b1988-d122-44c4-abd5-fb65b86e31b2 tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36fcd3d9c490413ab9429bccdad444cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d0c865636434569b3e25362dc02d5b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:19:40.310385 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-948b1988-d122-44c4-abd5-fb65b86e31b2 tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] 10.222.0.43 "GET /compute/v2.1/servers/0ea2e9da-6298-4fff-9acc-1b2777314b79" status: 200 len: 1266 microversion: 2.1 time: 0.163822 Jun 29 08:19:40.310862 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 522/1052] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:19:40 2022] GET /compute/v2.1/servers/0ea2e9da-6298-4fff-9acc-1b2777314b79 => generated 1266 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:19:41.324562 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_cell0:SELECT=2 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:19:41.329086 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-02d84d7c-86c0-41a9-8f03-2af38405b21d tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:19:41.329723 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-02d84d7c-86c0-41a9-8f03-2af38405b21d tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] [instance: 0ea2e9da-6298-4fff-9acc-1b2777314b79] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:19:41.336950 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-02d84d7c-86c0-41a9-8f03-2af38405b21d tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:19:41.337554 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-02d84d7c-86c0-41a9-8f03-2af38405b21d tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:19:41.338351 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-02d84d7c-86c0-41a9-8f03-2af38405b21d tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:19:41.338795 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-02d84d7c-86c0-41a9-8f03-2af38405b21d tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:19:41.474162 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-02d84d7c-86c0-41a9-8f03-2af38405b21d tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36fcd3d9c490413ab9429bccdad444cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d0c865636434569b3e25362dc02d5b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:19:41.481764 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-02d84d7c-86c0-41a9-8f03-2af38405b21d tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] 10.222.0.43 "GET /compute/v2.1/servers/0ea2e9da-6298-4fff-9acc-1b2777314b79" status: 200 len: 1266 microversion: 2.1 time: 0.158452 Jun 29 08:19:41.482614 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 531/1053] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:19:41 2022] GET /compute/v2.1/servers/0ea2e9da-6298-4fff-9acc-1b2777314b79 => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:19:42.498656 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-f9851484-bb9d-4497-8a7d-ef3d8726918d tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:19:42.499337 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-f9851484-bb9d-4497-8a7d-ef3d8726918d tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] [instance: 0ea2e9da-6298-4fff-9acc-1b2777314b79] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:19:42.501115 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG dbcounter [-] [117890] Writing DB stats nova_cell0:SELECT=2 {{(pid=117890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:19:42.501801 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG dbcounter [-] [117890] Writing DB stats nova_cell0:SELECT=6 {{(pid=117890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:19:42.508996 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-f9851484-bb9d-4497-8a7d-ef3d8726918d tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:19:42.509438 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-f9851484-bb9d-4497-8a7d-ef3d8726918d tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:19:42.510208 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-f9851484-bb9d-4497-8a7d-ef3d8726918d tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:19:42.510639 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-f9851484-bb9d-4497-8a7d-ef3d8726918d tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:19:42.666712 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-f9851484-bb9d-4497-8a7d-ef3d8726918d tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36fcd3d9c490413ab9429bccdad444cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d0c865636434569b3e25362dc02d5b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:19:42.674777 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-f9851484-bb9d-4497-8a7d-ef3d8726918d tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] 10.222.0.43 "GET /compute/v2.1/servers/0ea2e9da-6298-4fff-9acc-1b2777314b79" status: 200 len: 1266 microversion: 2.1 time: 0.179575 Jun 29 08:19:42.675364 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 523/1054] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:19:42 2022] GET /compute/v2.1/servers/0ea2e9da-6298-4fff-9acc-1b2777314b79 => generated 1266 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:19:43.475520 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [req-1eadd5f3-21ac-4914-a4ac-027638afb19b req-0861be58-27b5-44f7-bda5-e02a8d80c869 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ea2e9da-6298-4fff-9acc-1b2777314b79", "name": "network-vif-plugged", "status": "completed", "tag": "87c86cee-4821-4d39-868c-0bc1b50c262c"}]} {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:19:43.484659 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-1eadd5f3-21ac-4914-a4ac-027638afb19b req-0861be58-27b5-44f7-bda5-e02a8d80c869 service nova] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:19:43.485004 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [req-1eadd5f3-21ac-4914-a4ac-027638afb19b req-0861be58-27b5-44f7-bda5-e02a8d80c869 service nova] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:19:43.498639 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.compute.server_external_events [req-1eadd5f3-21ac-4914-a4ac-027638afb19b req-0861be58-27b5-44f7-bda5-e02a8d80c869 service nova] Creating event network-vif-plugged:87c86cee-4821-4d39-868c-0bc1b50c262c for instance 0ea2e9da-6298-4fff-9acc-1b2777314b79 on hv-cinder-76810 Jun 29 08:19:43.504641 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [req-1eadd5f3-21ac-4914-a4ac-027638afb19b req-0861be58-27b5-44f7-bda5-e02a8d80c869 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034283 Jun 29 08:19:43.505285 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 532/1055] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jun 29 08:19:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:19:43.693169 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-dbcf3932-e7ea-4b26-a1f6-4e054105086a tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:19:43.693795 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-dbcf3932-e7ea-4b26-a1f6-4e054105086a tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] [instance: 0ea2e9da-6298-4fff-9acc-1b2777314b79] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:19:43.700510 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-dbcf3932-e7ea-4b26-a1f6-4e054105086a tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:19:43.700959 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-dbcf3932-e7ea-4b26-a1f6-4e054105086a tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:19:43.701756 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-dbcf3932-e7ea-4b26-a1f6-4e054105086a tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:19:43.702195 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-dbcf3932-e7ea-4b26-a1f6-4e054105086a tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:19:43.890203 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-dbcf3932-e7ea-4b26-a1f6-4e054105086a tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36fcd3d9c490413ab9429bccdad444cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d0c865636434569b3e25362dc02d5b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:19:43.897909 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-dbcf3932-e7ea-4b26-a1f6-4e054105086a tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] 10.222.0.43 "GET /compute/v2.1/servers/0ea2e9da-6298-4fff-9acc-1b2777314b79" status: 200 len: 1266 microversion: 2.1 time: 0.210098 Jun 29 08:19:43.898488 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 524/1056] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:19:43 2022] GET /compute/v2.1/servers/0ea2e9da-6298-4fff-9acc-1b2777314b79 => generated 1266 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:19:44.915672 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-100ceb27-ca07-43c9-a832-c3ec28ee82ea tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:19:44.916379 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-100ceb27-ca07-43c9-a832-c3ec28ee82ea tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] [instance: 0ea2e9da-6298-4fff-9acc-1b2777314b79] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:19:44.923149 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-100ceb27-ca07-43c9-a832-c3ec28ee82ea tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:19:44.923606 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-100ceb27-ca07-43c9-a832-c3ec28ee82ea tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:19:44.924464 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-100ceb27-ca07-43c9-a832-c3ec28ee82ea tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:19:44.924831 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-100ceb27-ca07-43c9-a832-c3ec28ee82ea tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:19:45.060144 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-100ceb27-ca07-43c9-a832-c3ec28ee82ea tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36fcd3d9c490413ab9429bccdad444cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d0c865636434569b3e25362dc02d5b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:19:45.069283 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-100ceb27-ca07-43c9-a832-c3ec28ee82ea tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] 10.222.0.43 "GET /compute/v2.1/servers/0ea2e9da-6298-4fff-9acc-1b2777314b79" status: 200 len: 1266 microversion: 2.1 time: 0.157743 Jun 29 08:19:45.069875 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 533/1057] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:19:44 2022] GET /compute/v2.1/servers/0ea2e9da-6298-4fff-9acc-1b2777314b79 => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:19:46.086096 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-ac283bf3-146d-4832-8318-2eff7c3bc950 tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:19:46.086717 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-ac283bf3-146d-4832-8318-2eff7c3bc950 tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] [instance: 0ea2e9da-6298-4fff-9acc-1b2777314b79] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:19:46.093314 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-ac283bf3-146d-4832-8318-2eff7c3bc950 tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:19:46.093760 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-ac283bf3-146d-4832-8318-2eff7c3bc950 tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:19:46.094525 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-ac283bf3-146d-4832-8318-2eff7c3bc950 tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:19:46.094959 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-ac283bf3-146d-4832-8318-2eff7c3bc950 tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:19:46.472530 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-ac283bf3-146d-4832-8318-2eff7c3bc950 tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36fcd3d9c490413ab9429bccdad444cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d0c865636434569b3e25362dc02d5b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:19:46.480728 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-ac283bf3-146d-4832-8318-2eff7c3bc950 tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] 10.222.0.43 "GET /compute/v2.1/servers/0ea2e9da-6298-4fff-9acc-1b2777314b79" status: 200 len: 1453 microversion: 2.1 time: 0.398732 Jun 29 08:19:46.481333 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 525/1058] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:19:46 2022] GET /compute/v2.1/servers/0ea2e9da-6298-4fff-9acc-1b2777314b79 => generated 1453 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:19:46.498026 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-5e42ff1f-9fb4-4f2d-b976-26b135c9dae0 tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:19:46.498640 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-5e42ff1f-9fb4-4f2d-b976-26b135c9dae0 tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] [instance: 0ea2e9da-6298-4fff-9acc-1b2777314b79] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:19:46.505749 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-5e42ff1f-9fb4-4f2d-b976-26b135c9dae0 tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:19:46.506203 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-5e42ff1f-9fb4-4f2d-b976-26b135c9dae0 tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:19:46.506977 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-5e42ff1f-9fb4-4f2d-b976-26b135c9dae0 tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:19:46.507416 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-5e42ff1f-9fb4-4f2d-b976-26b135c9dae0 tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:19:46.640670 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-5e42ff1f-9fb4-4f2d-b976-26b135c9dae0 tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36fcd3d9c490413ab9429bccdad444cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d0c865636434569b3e25362dc02d5b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:19:46.648365 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-5e42ff1f-9fb4-4f2d-b976-26b135c9dae0 tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] 10.222.0.43 "GET /compute/v2.1/servers/0ea2e9da-6298-4fff-9acc-1b2777314b79" status: 200 len: 1453 microversion: 2.1 time: 0.154270 Jun 29 08:19:46.648927 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 534/1059] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:19:46 2022] GET /compute/v2.1/servers/0ea2e9da-6298-4fff-9acc-1b2777314b79 => generated 1453 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:19:48.264537 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [req-42f6a614-097a-4144-8603-4cb2bd97dc8a req-decdbe83-fab2-4680-b441-a1f421f65f85 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0ea2e9da-6298-4fff-9acc-1b2777314b79", "tag": "87c86cee-4821-4d39-868c-0bc1b50c262c"}]} {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:19:48.275277 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [req-42f6a614-097a-4144-8603-4cb2bd97dc8a req-decdbe83-fab2-4680-b441-a1f421f65f85 service nova] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:19:48.276027 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [req-42f6a614-097a-4144-8603-4cb2bd97dc8a req-decdbe83-fab2-4680-b441-a1f421f65f85 service nova] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:19:48.293736 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.compute.server_external_events [req-42f6a614-097a-4144-8603-4cb2bd97dc8a req-decdbe83-fab2-4680-b441-a1f421f65f85 service nova] Creating event network-changed:87c86cee-4821-4d39-868c-0bc1b50c262c for instance 0ea2e9da-6298-4fff-9acc-1b2777314b79 on hv-cinder-76810 Jun 29 08:19:48.298930 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [req-42f6a614-097a-4144-8603-4cb2bd97dc8a req-decdbe83-fab2-4680-b441-a1f421f65f85 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038814 Jun 29 08:19:48.299856 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 526/1060] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jun 29 08:19:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:21:16.373198 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_api:SELECT=20 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:21:16.377044 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG dbcounter [-] [117890] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=117890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:21:16.378179 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG dbcounter [-] [117889] Writing DB stats nova_cell1:SELECT=44 {{(pid=117889) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:21:16.378916 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG dbcounter [-] [117890] Writing DB stats nova_cell1:SELECT=48 {{(pid=117890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 29 08:21:16.389612 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-a06eaa9e-818b-40f1-b81e-78213fc81026 tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:21:16.390112 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-a06eaa9e-818b-40f1-b81e-78213fc81026 tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] [instance: 0ea2e9da-6298-4fff-9acc-1b2777314b79] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:21:16.400033 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-a06eaa9e-818b-40f1-b81e-78213fc81026 tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:21:16.400239 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-a06eaa9e-818b-40f1-b81e-78213fc81026 tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:21:16.400912 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-a06eaa9e-818b-40f1-b81e-78213fc81026 tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:21:16.401373 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-a06eaa9e-818b-40f1-b81e-78213fc81026 tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:21:16.427214 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-a06eaa9e-818b-40f1-b81e-78213fc81026 tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] [instance: 0ea2e9da-6298-4fff-9acc-1b2777314b79] Going to try to terminate instance {{(pid=117889) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 29 08:21:16.446291 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [req-3f4b9d5c-dd1c-447e-a9d0-338a95d3a76d req-32d2bb31-b1c2-473a-a774-7306c9d0265a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0ea2e9da-6298-4fff-9acc-1b2777314b79", "tag": "87c86cee-4821-4d39-868c-0bc1b50c262c"}]} {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:21:16.454252 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [req-3f4b9d5c-dd1c-447e-a9d0-338a95d3a76d req-32d2bb31-b1c2-473a-a774-7306c9d0265a service nova] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:21:16.455073 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [req-3f4b9d5c-dd1c-447e-a9d0-338a95d3a76d req-32d2bb31-b1c2-473a-a774-7306c9d0265a service nova] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:21:16.466684 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.compute.server_external_events [req-3f4b9d5c-dd1c-447e-a9d0-338a95d3a76d req-32d2bb31-b1c2-473a-a774-7306c9d0265a service nova] Creating event network-changed:87c86cee-4821-4d39-868c-0bc1b50c262c for instance 0ea2e9da-6298-4fff-9acc-1b2777314b79 on hv-cinder-76810 Jun 29 08:21:16.471872 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [req-3f4b9d5c-dd1c-447e-a9d0-338a95d3a76d req-32d2bb31-b1c2-473a-a774-7306c9d0265a service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096790 Jun 29 08:21:16.472682 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 527/1061] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jun 29 08:21:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:21:16.528156 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-a06eaa9e-818b-40f1-b81e-78213fc81026 tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] 10.222.0.43 "DELETE /compute/v2.1/servers/0ea2e9da-6298-4fff-9acc-1b2777314b79" status: 204 len: 0 microversion: 2.1 time: 0.157111 Jun 29 08:21:16.529480 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 535/1062] 10.222.0.43 () {58 vars in 1238 bytes} [Wed Jun 29 08:21:16 2022] DELETE /compute/v2.1/servers/0ea2e9da-6298-4fff-9acc-1b2777314b79 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 29 08:21:16.537795 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-b9f0afe1-d60f-4d25-a89b-7d646004b164 tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:21:16.539164 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-b9f0afe1-d60f-4d25-a89b-7d646004b164 tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] [instance: 0ea2e9da-6298-4fff-9acc-1b2777314b79] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:21:16.545728 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-b9f0afe1-d60f-4d25-a89b-7d646004b164 tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:21:16.546247 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-b9f0afe1-d60f-4d25-a89b-7d646004b164 tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:21:16.547215 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-b9f0afe1-d60f-4d25-a89b-7d646004b164 tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:21:16.547712 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-b9f0afe1-d60f-4d25-a89b-7d646004b164 tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:21:16.687576 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-b9f0afe1-d60f-4d25-a89b-7d646004b164 tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36fcd3d9c490413ab9429bccdad444cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d0c865636434569b3e25362dc02d5b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:21:16.695239 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-b9f0afe1-d60f-4d25-a89b-7d646004b164 tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] 10.222.0.43 "GET /compute/v2.1/servers/0ea2e9da-6298-4fff-9acc-1b2777314b79" status: 200 len: 1578 microversion: 2.1 time: 0.161973 Jun 29 08:21:16.695808 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 528/1063] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:21:16 2022] GET /compute/v2.1/servers/0ea2e9da-6298-4fff-9acc-1b2777314b79 => generated 1578 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:21:17.712788 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-f1a0f6f7-5484-488d-abaf-b2c7379b8960 tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:21:17.713614 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-f1a0f6f7-5484-488d-abaf-b2c7379b8960 tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] [instance: 0ea2e9da-6298-4fff-9acc-1b2777314b79] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:21:17.720295 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-f1a0f6f7-5484-488d-abaf-b2c7379b8960 tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:21:17.720750 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-f1a0f6f7-5484-488d-abaf-b2c7379b8960 tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:21:17.721543 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-f1a0f6f7-5484-488d-abaf-b2c7379b8960 tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:21:17.721980 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-f1a0f6f7-5484-488d-abaf-b2c7379b8960 tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:21:17.872008 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-f1a0f6f7-5484-488d-abaf-b2c7379b8960 tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36fcd3d9c490413ab9429bccdad444cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d0c865636434569b3e25362dc02d5b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:21:17.881452 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-f1a0f6f7-5484-488d-abaf-b2c7379b8960 tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] 10.222.0.43 "GET /compute/v2.1/servers/0ea2e9da-6298-4fff-9acc-1b2777314b79" status: 200 len: 1578 microversion: 2.1 time: 0.173462 Jun 29 08:21:17.882033 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 536/1064] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:21:17 2022] GET /compute/v2.1/servers/0ea2e9da-6298-4fff-9acc-1b2777314b79 => generated 1578 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:21:18.758379 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [req-0c322f55-af35-4367-a8f1-40e47615c791 req-a91c832f-f518-4a22-bb87-a37dc6229329 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ea2e9da-6298-4fff-9acc-1b2777314b79", "name": "network-vif-deleted", "tag": "87c86cee-4821-4d39-868c-0bc1b50c262c"}]} {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:21:18.769136 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [req-0c322f55-af35-4367-a8f1-40e47615c791 req-a91c832f-f518-4a22-bb87-a37dc6229329 service nova] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:21:18.769578 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [req-0c322f55-af35-4367-a8f1-40e47615c791 req-a91c832f-f518-4a22-bb87-a37dc6229329 service nova] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:21:18.782341 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.compute.server_external_events [req-0c322f55-af35-4367-a8f1-40e47615c791 req-a91c832f-f518-4a22-bb87-a37dc6229329 service nova] Creating event network-vif-deleted:87c86cee-4821-4d39-868c-0bc1b50c262c for instance 0ea2e9da-6298-4fff-9acc-1b2777314b79 on hv-cinder-76810 Jun 29 08:21:18.790248 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [req-0c322f55-af35-4367-a8f1-40e47615c791 req-a91c832f-f518-4a22-bb87-a37dc6229329 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035139 Jun 29 08:21:18.790841 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 529/1065] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jun 29 08:21:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:21:18.900523 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-cefd3332-7e07-4530-b1ce-1dbe8e96127c tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:21:18.901181 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-cefd3332-7e07-4530-b1ce-1dbe8e96127c tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] [instance: 0ea2e9da-6298-4fff-9acc-1b2777314b79] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:21:18.907880 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-cefd3332-7e07-4530-b1ce-1dbe8e96127c tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:21:18.908334 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-cefd3332-7e07-4530-b1ce-1dbe8e96127c tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:21:18.909144 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-cefd3332-7e07-4530-b1ce-1dbe8e96127c tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:21:18.909593 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-cefd3332-7e07-4530-b1ce-1dbe8e96127c tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:21:18.971295 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-cefd3332-7e07-4530-b1ce-1dbe8e96127c tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36fcd3d9c490413ab9429bccdad444cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d0c865636434569b3e25362dc02d5b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:21:18.979421 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-cefd3332-7e07-4530-b1ce-1dbe8e96127c tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] 10.222.0.43 "GET /compute/v2.1/servers/0ea2e9da-6298-4fff-9acc-1b2777314b79" status: 200 len: 1226 microversion: 2.1 time: 0.083549 Jun 29 08:21:18.979989 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 537/1066] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:21:18 2022] GET /compute/v2.1/servers/0ea2e9da-6298-4fff-9acc-1b2777314b79 => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:21:19.551429 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 29 08:21:19.551704 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: Wed Jun 29 08:21:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 29 08:21:19.998713 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-4c9115a4-1b8e-443b-a8b2-c75c0ebf0eaa tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:21:19.999407 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-4c9115a4-1b8e-443b-a8b2-c75c0ebf0eaa tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] [instance: 0ea2e9da-6298-4fff-9acc-1b2777314b79] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:21:20.006342 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-4c9115a4-1b8e-443b-a8b2-c75c0ebf0eaa tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:21:20.006783 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-4c9115a4-1b8e-443b-a8b2-c75c0ebf0eaa tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:21:20.008356 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-4c9115a4-1b8e-443b-a8b2-c75c0ebf0eaa tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:21:20.008790 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-4c9115a4-1b8e-443b-a8b2-c75c0ebf0eaa tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:21:20.022233 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.wsgi [None req-4c9115a4-1b8e-443b-a8b2-c75c0ebf0eaa tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] HTTP exception thrown: Instance 0ea2e9da-6298-4fff-9acc-1b2777314b79 could not be found. Jun 29 08:21:20.024287 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-4c9115a4-1b8e-443b-a8b2-c75c0ebf0eaa tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Request method failure captured: Jun 29 08:21:20.024287 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: request: GET /compute/v2.1/servers/0ea2e9da-6298-4fff-9acc-1b2777314b79 HTTP/1.1 Jun 29 08:21:20.024287 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: Accept: application/json Jun 29 08:21:20.024287 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: Accept-Encoding: identity Jun 29 08:21:20.024287 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: Connection: close Jun 29 08:21:20.024287 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: Content-Length: 0 Jun 29 08:21:20.024287 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: Content-Type: application/json Jun 29 08:21:20.024287 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: Host: 10.222.0.43 Jun 29 08:21:20.024287 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: Openstack-System-Scope: None Jun 29 08:21:20.024287 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: User-Agent: python-urllib3/1.26.9 Jun 29 08:21:20.024287 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Auth-Token: gAAAAABivAoGY6uFi1ES8uYciUsYTi7e52XuVlKhKZ-pFuhsbIEMlIAnzWczEIhBVXzUy7PhTY6OsMmCGfi12PcK94PKpbbtc8hj_Mq_nsegxtyMlT1nNFJwLDSaLzX82lKEfy_vfWjud_qiJ7hLMlzsopelkHH0uijVjdtkQbKXpLTAoR0DKrs Jun 29 08:21:20.024287 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Domain-Id: None Jun 29 08:21:20.024287 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Domain-Name: None Jun 29 08:21:20.024287 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Identity-Status: Confirmed Jun 29 08:21:20.024287 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Is-Admin-Project: True Jun 29 08:21:20.024287 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Project-Domain-Id: default Jun 29 08:21:20.024287 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Project-Domain-Name: Default Jun 29 08:21:20.024287 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Project-Id: 1d0c865636434569b3e25362dc02d5b8 Jun 29 08:21:20.024287 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Project-Name: tempest-TestVolumeBootPattern-1408846588 Jun 29 08:21:20.024287 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Role: member,reader Jun 29 08:21:20.024287 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Roles: member,reader Jun 29 08:21:20.027451 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/1d0c865636434569b3e25362dc02d5b8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_1d0c865636434569b3e25362dc02d5b8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/1d0c865636434569b3e25362dc02d5b8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/1d0c865636434569b3e25362dc02d5b8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Jun 29 08:21:20.027451 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Tenant: tempest-TestVolumeBootPattern-1408846588 Jun 29 08:21:20.027451 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Tenant-Id: 1d0c865636434569b3e25362dc02d5b8 Jun 29 08:21:20.027451 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Tenant-Name: tempest-TestVolumeBootPattern-1408846588 Jun 29 08:21:20.027451 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-User: tempest-TestVolumeBootPattern-1408846588-project Jun 29 08:21:20.027451 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-User-Domain-Id: default Jun 29 08:21:20.027451 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-User-Domain-Name: Default Jun 29 08:21:20.027451 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-User-Id: 36fcd3d9c490413ab9429bccdad444cb Jun 29 08:21:20.027451 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-User-Name: tempest-TestVolumeBootPattern-1408846588-project Jun 29 08:21:20.027451 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: method: > Jun 29 08:21:20.027451 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: exception: Instance 0ea2e9da-6298-4fff-9acc-1b2777314b79 could not be found. Jun 29 08:21:20.027451 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: action_args: {'id': '0ea2e9da-6298-4fff-9acc-1b2777314b79'} Jun 29 08:21:20.028463 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 08:21:20.028463 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:21:20.028463 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 29 08:21:20.028463 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 29 08:21:20.028463 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 29 08:21:20.028463 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 29 08:21:20.028463 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 29 08:21:20.028463 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 29 08:21:20.028463 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 29 08:21:20.028463 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 29 08:21:20.028463 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0ea2e9da-6298-4fff-9acc-1b2777314b79 could not be found. Jun 29 08:21:20.028463 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 29 08:21:20.028463 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 08:21:20.028463 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 29 08:21:20.028463 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:21:20.028463 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 08:21:20.028463 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 08:21:20.028463 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 08:21:20.028463 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 08:21:20.028463 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 08:21:20.032388 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 08:21:20.032388 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 29 08:21:20.032388 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 29 08:21:20.032388 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 29 08:21:20.032388 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 29 08:21:20.032388 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 29 08:21:20.032388 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 29 08:21:20.032388 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0ea2e9da-6298-4fff-9acc-1b2777314b79 could not be found. Jun 29 08:21:20.032388 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 29 08:21:20.032388 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 08:21:20.032388 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 29 08:21:20.032388 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:21:20.032388 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 08:21:20.032388 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 08:21:20.032388 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 08:21:20.032388 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 08:21:20.032388 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0ea2e9da-6298-4fff-9acc-1b2777314b79 could not be found. Jun 29 08:21:20.032388 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 29 08:21:20.034188 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-4c9115a4-1b8e-443b-a8b2-c75c0ebf0eaa tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Returning 404 to user: Instance 0ea2e9da-6298-4fff-9acc-1b2777314b79 could not be found. {{(pid=117890) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 08:21:20.034188 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-4c9115a4-1b8e-443b-a8b2-c75c0ebf0eaa tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] 10.222.0.43 "GET /compute/v2.1/servers/0ea2e9da-6298-4fff-9acc-1b2777314b79" status: 404 len: 111 microversion: 2.1 time: 0.031722 Jun 29 08:21:20.034188 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 530/1067] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:21:19 2022] GET /compute/v2.1/servers/0ea2e9da-6298-4fff-9acc-1b2777314b79 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 29 08:21:23.092658 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [req-e631ad92-3d8f-48e9-8544-084aabe890ea req-55524a1a-cdac-4a8a-9359-96262f50e864 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "13ef577f-d316-4519-8503-5817813a3d6b", "tag": "f9a0dbb5-9271-4850-a567-692f86b3599e"}]} {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:21:23.095742 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-aeac1a0a-77a4-495e-98f6-e7cbae6e4d54 tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:21:23.101686 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-aeac1a0a-77a4-495e-98f6-e7cbae6e4d54 tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] [instance: 13ef577f-d316-4519-8503-5817813a3d6b] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:21:23.105646 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [req-e631ad92-3d8f-48e9-8544-084aabe890ea req-55524a1a-cdac-4a8a-9359-96262f50e864 service nova] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:21:23.106298 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [req-e631ad92-3d8f-48e9-8544-084aabe890ea req-55524a1a-cdac-4a8a-9359-96262f50e864 service nova] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:21:23.107070 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-aeac1a0a-77a4-495e-98f6-e7cbae6e4d54 tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:21:23.107599 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-aeac1a0a-77a4-495e-98f6-e7cbae6e4d54 tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:21:23.108497 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-aeac1a0a-77a4-495e-98f6-e7cbae6e4d54 tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:21:23.109045 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-aeac1a0a-77a4-495e-98f6-e7cbae6e4d54 tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:21:23.118004 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.compute.server_external_events [req-e631ad92-3d8f-48e9-8544-084aabe890ea req-55524a1a-cdac-4a8a-9359-96262f50e864 service nova] Creating event network-changed:f9a0dbb5-9271-4850-a567-692f86b3599e for instance 13ef577f-d316-4519-8503-5817813a3d6b on hv-cinder-76810 Jun 29 08:21:23.123078 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [req-e631ad92-3d8f-48e9-8544-084aabe890ea req-55524a1a-cdac-4a8a-9359-96262f50e864 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034014 Jun 29 08:21:23.124621 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 531/1068] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jun 29 08:21:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 29 08:21:23.135592 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-aeac1a0a-77a4-495e-98f6-e7cbae6e4d54 tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] [instance: 13ef577f-d316-4519-8503-5817813a3d6b] Going to try to terminate instance {{(pid=117889) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 29 08:21:23.227793 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-aeac1a0a-77a4-495e-98f6-e7cbae6e4d54 tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] 10.222.0.43 "DELETE /compute/v2.1/servers/13ef577f-d316-4519-8503-5817813a3d6b" status: 204 len: 0 microversion: 2.1 time: 0.142012 Jun 29 08:21:23.228562 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 538/1069] 10.222.0.43 () {58 vars in 1238 bytes} [Wed Jun 29 08:21:23 2022] DELETE /compute/v2.1/servers/13ef577f-d316-4519-8503-5817813a3d6b => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 29 08:21:23.237330 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-0c2bc08a-fe8b-4885-a3d4-9d6f1472faee tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:21:23.238033 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-0c2bc08a-fe8b-4885-a3d4-9d6f1472faee tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] [instance: 13ef577f-d316-4519-8503-5817813a3d6b] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:21:23.245585 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-0c2bc08a-fe8b-4885-a3d4-9d6f1472faee tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:21:23.246031 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-0c2bc08a-fe8b-4885-a3d4-9d6f1472faee tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:21:23.247004 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-0c2bc08a-fe8b-4885-a3d4-9d6f1472faee tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:21:23.247684 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-0c2bc08a-fe8b-4885-a3d4-9d6f1472faee tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:21:23.661876 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-0c2bc08a-fe8b-4885-a3d4-9d6f1472faee tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36fcd3d9c490413ab9429bccdad444cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d0c865636434569b3e25362dc02d5b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:21:23.670291 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-0c2bc08a-fe8b-4885-a3d4-9d6f1472faee tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] 10.222.0.43 "GET /compute/v2.1/servers/13ef577f-d316-4519-8503-5817813a3d6b" status: 200 len: 1576 microversion: 2.1 time: 0.437300 Jun 29 08:21:23.670869 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 532/1070] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:21:23 2022] GET /compute/v2.1/servers/13ef577f-d316-4519-8503-5817813a3d6b => generated 1576 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:21:24.688012 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-ab833046-3a6d-43be-bec5-981ab0464f49 tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:21:24.688634 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-ab833046-3a6d-43be-bec5-981ab0464f49 tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] [instance: 13ef577f-d316-4519-8503-5817813a3d6b] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:21:24.696102 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ab833046-3a6d-43be-bec5-981ab0464f49 tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:21:24.696552 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ab833046-3a6d-43be-bec5-981ab0464f49 tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:21:24.697633 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ab833046-3a6d-43be-bec5-981ab0464f49 tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:21:24.698071 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-ab833046-3a6d-43be-bec5-981ab0464f49 tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:21:24.832616 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-ab833046-3a6d-43be-bec5-981ab0464f49 tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36fcd3d9c490413ab9429bccdad444cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d0c865636434569b3e25362dc02d5b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:21:24.843441 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-ab833046-3a6d-43be-bec5-981ab0464f49 tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] 10.222.0.43 "GET /compute/v2.1/servers/13ef577f-d316-4519-8503-5817813a3d6b" status: 200 len: 1576 microversion: 2.1 time: 0.159768 Jun 29 08:21:24.844027 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 539/1071] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:21:24 2022] GET /compute/v2.1/servers/13ef577f-d316-4519-8503-5817813a3d6b => generated 1576 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:21:25.101690 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 29 08:21:25.102245 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: Wed Jun 29 08:21:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 29 08:21:25.313754 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [req-56a38026-154c-4a45-89ca-98bca41df44f req-9ff7dacd-28f7-4c36-b234-05df7f5cc371 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13ef577f-d316-4519-8503-5817813a3d6b", "name": "network-vif-deleted", "tag": "f9a0dbb5-9271-4850-a567-692f86b3599e"}]} {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 29 08:21:25.322259 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [req-56a38026-154c-4a45-89ca-98bca41df44f req-9ff7dacd-28f7-4c36-b234-05df7f5cc371 service nova] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:21:25.322708 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [req-56a38026-154c-4a45-89ca-98bca41df44f req-9ff7dacd-28f7-4c36-b234-05df7f5cc371 service nova] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:21:25.333825 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.compute.server_external_events [req-56a38026-154c-4a45-89ca-98bca41df44f req-9ff7dacd-28f7-4c36-b234-05df7f5cc371 service nova] Creating event network-vif-deleted:f9a0dbb5-9271-4850-a567-692f86b3599e for instance 13ef577f-d316-4519-8503-5817813a3d6b on hv-cinder-76810 Jun 29 08:21:25.339256 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [req-56a38026-154c-4a45-89ca-98bca41df44f req-9ff7dacd-28f7-4c36-b234-05df7f5cc371 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029205 Jun 29 08:21:25.339944 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 533/1072] 10.222.0.43 () {64 vars in 1317 bytes} [Wed Jun 29 08:21:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 29 08:21:25.860246 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-63aa09ea-9b3d-44c7-9262-b425b59041ba tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:21:25.860800 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-63aa09ea-9b3d-44c7-9262-b425b59041ba tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] [instance: 13ef577f-d316-4519-8503-5817813a3d6b] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:21:25.867411 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-63aa09ea-9b3d-44c7-9262-b425b59041ba tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:21:25.867854 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-63aa09ea-9b3d-44c7-9262-b425b59041ba tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:21:25.868613 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-63aa09ea-9b3d-44c7-9262-b425b59041ba tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:21:25.869074 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-63aa09ea-9b3d-44c7-9262-b425b59041ba tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:21:25.901839 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-63aa09ea-9b3d-44c7-9262-b425b59041ba tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:21:25.902284 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-63aa09ea-9b3d-44c7-9262-b425b59041ba tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:21:25.902727 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.objects.instance [None req-63aa09ea-9b3d-44c7-9262-b425b59041ba tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Lazy-loading 'fault' on Instance uuid 13ef577f-d316-4519-8503-5817813a3d6b {{(pid=117889) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 29 08:21:25.942689 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.policy [None req-63aa09ea-9b3d-44c7-9262-b425b59041ba tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36fcd3d9c490413ab9429bccdad444cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d0c865636434569b3e25362dc02d5b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117889) authorize /opt/stack/nova/nova/policy.py:199}} Jun 29 08:21:25.951476 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-63aa09ea-9b3d-44c7-9262-b425b59041ba tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] 10.222.0.43 "GET /compute/v2.1/servers/13ef577f-d316-4519-8503-5817813a3d6b" status: 200 len: 1231 microversion: 2.1 time: 0.095176 Jun 29 08:21:25.952048 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 540/1073] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:21:25 2022] GET /compute/v2.1/servers/13ef577f-d316-4519-8503-5817813a3d6b => generated 1231 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 29 08:21:26.970257 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-916fb9d8-1802-4ddf-83b1-7bcec0184b4f tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:21:26.971003 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-916fb9d8-1802-4ddf-83b1-7bcec0184b4f tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] [instance: 13ef577f-d316-4519-8503-5817813a3d6b] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:21:26.978743 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-916fb9d8-1802-4ddf-83b1-7bcec0184b4f tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:21:26.979195 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-916fb9d8-1802-4ddf-83b1-7bcec0184b4f tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:21:26.980047 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-916fb9d8-1802-4ddf-83b1-7bcec0184b4f tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:21:26.980487 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-916fb9d8-1802-4ddf-83b1-7bcec0184b4f tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:21:26.995384 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.wsgi [None req-916fb9d8-1802-4ddf-83b1-7bcec0184b4f tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] HTTP exception thrown: Instance 13ef577f-d316-4519-8503-5817813a3d6b could not be found. Jun 29 08:21:26.997066 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-916fb9d8-1802-4ddf-83b1-7bcec0184b4f tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Request method failure captured: Jun 29 08:21:26.997066 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: request: GET /compute/v2.1/servers/13ef577f-d316-4519-8503-5817813a3d6b HTTP/1.1 Jun 29 08:21:26.997066 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: Accept: application/json Jun 29 08:21:26.997066 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: Accept-Encoding: identity Jun 29 08:21:26.997066 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: Connection: close Jun 29 08:21:26.997066 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: Content-Length: 0 Jun 29 08:21:26.997066 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: Content-Type: application/json Jun 29 08:21:26.997066 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: Host: 10.222.0.43 Jun 29 08:21:26.997066 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: Openstack-System-Scope: None Jun 29 08:21:26.997066 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: User-Agent: python-urllib3/1.26.9 Jun 29 08:21:26.997066 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Auth-Token: gAAAAABivAoGY6uFi1ES8uYciUsYTi7e52XuVlKhKZ-pFuhsbIEMlIAnzWczEIhBVXzUy7PhTY6OsMmCGfi12PcK94PKpbbtc8hj_Mq_nsegxtyMlT1nNFJwLDSaLzX82lKEfy_vfWjud_qiJ7hLMlzsopelkHH0uijVjdtkQbKXpLTAoR0DKrs Jun 29 08:21:26.997066 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Domain-Id: None Jun 29 08:21:26.997066 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Domain-Name: None Jun 29 08:21:26.997066 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Identity-Status: Confirmed Jun 29 08:21:26.997066 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Is-Admin-Project: True Jun 29 08:21:26.997066 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Project-Domain-Id: default Jun 29 08:21:26.997066 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Project-Domain-Name: Default Jun 29 08:21:26.997066 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Project-Id: 1d0c865636434569b3e25362dc02d5b8 Jun 29 08:21:26.997066 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Project-Name: tempest-TestVolumeBootPattern-1408846588 Jun 29 08:21:26.997066 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Role: member,reader Jun 29 08:21:26.997066 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Roles: member,reader Jun 29 08:21:26.998837 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/1d0c865636434569b3e25362dc02d5b8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_1d0c865636434569b3e25362dc02d5b8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/1d0c865636434569b3e25362dc02d5b8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/1d0c865636434569b3e25362dc02d5b8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Jun 29 08:21:26.998837 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Tenant: tempest-TestVolumeBootPattern-1408846588 Jun 29 08:21:26.998837 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Tenant-Id: 1d0c865636434569b3e25362dc02d5b8 Jun 29 08:21:26.998837 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Tenant-Name: tempest-TestVolumeBootPattern-1408846588 Jun 29 08:21:26.998837 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-User: tempest-TestVolumeBootPattern-1408846588-project Jun 29 08:21:26.998837 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-User-Domain-Id: default Jun 29 08:21:26.998837 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-User-Domain-Name: Default Jun 29 08:21:26.998837 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-User-Id: 36fcd3d9c490413ab9429bccdad444cb Jun 29 08:21:26.998837 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-User-Name: tempest-TestVolumeBootPattern-1408846588-project Jun 29 08:21:26.998837 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: method: > Jun 29 08:21:26.998837 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: exception: Instance 13ef577f-d316-4519-8503-5817813a3d6b could not be found. Jun 29 08:21:26.998837 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: action_args: {'id': '13ef577f-d316-4519-8503-5817813a3d6b'} Jun 29 08:21:26.999855 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 08:21:26.999855 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:21:26.999855 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 29 08:21:26.999855 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 29 08:21:26.999855 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 29 08:21:26.999855 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 29 08:21:26.999855 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 29 08:21:26.999855 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 29 08:21:26.999855 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 29 08:21:26.999855 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 29 08:21:26.999855 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 13ef577f-d316-4519-8503-5817813a3d6b could not be found. Jun 29 08:21:26.999855 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 29 08:21:26.999855 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 08:21:26.999855 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 29 08:21:26.999855 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:21:26.999855 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 08:21:26.999855 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 08:21:26.999855 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 08:21:26.999855 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 08:21:26.999855 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 08:21:27.001534 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 08:21:27.001534 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 29 08:21:27.001534 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 29 08:21:27.001534 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 29 08:21:27.001534 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 29 08:21:27.001534 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 29 08:21:27.001534 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 29 08:21:27.001534 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 13ef577f-d316-4519-8503-5817813a3d6b could not be found. Jun 29 08:21:27.001534 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 29 08:21:27.001534 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 08:21:27.001534 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 29 08:21:27.001534 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:21:27.001534 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 08:21:27.001534 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 08:21:27.001534 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 08:21:27.001534 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 08:21:27.001534 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 13ef577f-d316-4519-8503-5817813a3d6b could not be found. Jun 29 08:21:27.001534 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 29 08:21:27.003002 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-916fb9d8-1802-4ddf-83b1-7bcec0184b4f tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Returning 404 to user: Instance 13ef577f-d316-4519-8503-5817813a3d6b could not be found. {{(pid=117890) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 08:21:27.003002 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-916fb9d8-1802-4ddf-83b1-7bcec0184b4f tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] 10.222.0.43 "GET /compute/v2.1/servers/13ef577f-d316-4519-8503-5817813a3d6b" status: 404 len: 111 microversion: 2.1 time: 0.033227 Jun 29 08:21:27.003002 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 534/1074] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:21:26 2022] GET /compute/v2.1/servers/13ef577f-d316-4519-8503-5817813a3d6b => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 29 08:21:27.441625 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-528ba4ef-7710-40ad-b0bc-da113f15b8ff tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Calling method '>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:21:27.442146 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.compute.api [None req-528ba4ef-7710-40ad-b0bc-da113f15b8ff tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] [instance: d211a2b0-7991-46ac-9231-06e79c90778a] Fetching instance by UUID {{(pid=117889) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:21:27.449816 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-528ba4ef-7710-40ad-b0bc-da113f15b8ff tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:21:27.450272 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-528ba4ef-7710-40ad-b0bc-da113f15b8ff tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:21:27.451037 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-528ba4ef-7710-40ad-b0bc-da113f15b8ff tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:21:27.451477 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG oslo_concurrency.lockutils [None req-528ba4ef-7710-40ad-b0bc-da113f15b8ff tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117889) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:21:27.465407 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.wsgi [None req-528ba4ef-7710-40ad-b0bc-da113f15b8ff tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] HTTP exception thrown: Instance d211a2b0-7991-46ac-9231-06e79c90778a could not be found. Jun 29 08:21:27.467355 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-528ba4ef-7710-40ad-b0bc-da113f15b8ff tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Request method failure captured: Jun 29 08:21:27.467355 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: request: DELETE /compute/v2.1/servers/d211a2b0-7991-46ac-9231-06e79c90778a HTTP/1.1 Jun 29 08:21:27.467355 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: Accept: application/json Jun 29 08:21:27.467355 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: Accept-Encoding: identity Jun 29 08:21:27.467355 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: Connection: close Jun 29 08:21:27.467355 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: Content-Length: 0 Jun 29 08:21:27.467355 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: Content-Type: application/json Jun 29 08:21:27.467355 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: Host: 10.222.0.43 Jun 29 08:21:27.467355 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: Openstack-System-Scope: None Jun 29 08:21:27.467355 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: User-Agent: python-urllib3/1.26.9 Jun 29 08:21:27.467355 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Auth-Token: gAAAAABivAoGY6uFi1ES8uYciUsYTi7e52XuVlKhKZ-pFuhsbIEMlIAnzWczEIhBVXzUy7PhTY6OsMmCGfi12PcK94PKpbbtc8hj_Mq_nsegxtyMlT1nNFJwLDSaLzX82lKEfy_vfWjud_qiJ7hLMlzsopelkHH0uijVjdtkQbKXpLTAoR0DKrs Jun 29 08:21:27.467355 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Domain-Id: None Jun 29 08:21:27.467355 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Domain-Name: None Jun 29 08:21:27.467355 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Identity-Status: Confirmed Jun 29 08:21:27.467355 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Is-Admin-Project: True Jun 29 08:21:27.467355 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Project-Domain-Id: default Jun 29 08:21:27.467355 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Project-Domain-Name: Default Jun 29 08:21:27.467355 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Project-Id: 1d0c865636434569b3e25362dc02d5b8 Jun 29 08:21:27.467355 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Project-Name: tempest-TestVolumeBootPattern-1408846588 Jun 29 08:21:27.467355 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Role: member,reader Jun 29 08:21:27.467355 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Roles: member,reader Jun 29 08:21:27.469665 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/1d0c865636434569b3e25362dc02d5b8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_1d0c865636434569b3e25362dc02d5b8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/1d0c865636434569b3e25362dc02d5b8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/1d0c865636434569b3e25362dc02d5b8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Jun 29 08:21:27.469665 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Tenant: tempest-TestVolumeBootPattern-1408846588 Jun 29 08:21:27.469665 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Tenant-Id: 1d0c865636434569b3e25362dc02d5b8 Jun 29 08:21:27.469665 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-Tenant-Name: tempest-TestVolumeBootPattern-1408846588 Jun 29 08:21:27.469665 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-User: tempest-TestVolumeBootPattern-1408846588-project Jun 29 08:21:27.469665 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-User-Domain-Id: default Jun 29 08:21:27.469665 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-User-Domain-Name: Default Jun 29 08:21:27.469665 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-User-Id: 36fcd3d9c490413ab9429bccdad444cb Jun 29 08:21:27.469665 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: X-User-Name: tempest-TestVolumeBootPattern-1408846588-project Jun 29 08:21:27.469665 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: method: > Jun 29 08:21:27.469665 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: exception: Instance d211a2b0-7991-46ac-9231-06e79c90778a could not be found. Jun 29 08:21:27.469665 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: action_args: {'id': 'd211a2b0-7991-46ac-9231-06e79c90778a'} Jun 29 08:21:27.470705 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 08:21:27.470705 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:21:27.470705 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 29 08:21:27.470705 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 29 08:21:27.470705 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 29 08:21:27.470705 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 29 08:21:27.470705 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 29 08:21:27.470705 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 29 08:21:27.470705 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 29 08:21:27.470705 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 29 08:21:27.470705 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d211a2b0-7991-46ac-9231-06e79c90778a could not be found. Jun 29 08:21:27.470705 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 29 08:21:27.470705 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 08:21:27.470705 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 29 08:21:27.470705 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:21:27.470705 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 08:21:27.470705 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 08:21:27.470705 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 08:21:27.470705 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 08:21:27.470705 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 08:21:27.472911 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 08:21:27.472911 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 29 08:21:27.472911 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 29 08:21:27.472911 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 29 08:21:27.472911 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 29 08:21:27.472911 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 29 08:21:27.472911 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 29 08:21:27.472911 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 29 08:21:27.472911 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 29 08:21:27.472911 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d211a2b0-7991-46ac-9231-06e79c90778a could not be found. Jun 29 08:21:27.472911 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 29 08:21:27.472911 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 08:21:27.472911 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 29 08:21:27.472911 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:21:27.472911 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 08:21:27.472911 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 08:21:27.472911 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 08:21:27.472911 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 08:21:27.472911 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d211a2b0-7991-46ac-9231-06e79c90778a could not be found. Jun 29 08:21:27.472911 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: ERROR nova.api.openstack.wsgi Jun 29 08:21:27.474572 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-528ba4ef-7710-40ad-b0bc-da113f15b8ff tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Returning 404 to user: Instance d211a2b0-7991-46ac-9231-06e79c90778a could not be found. {{(pid=117889) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 08:21:27.474572 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-528ba4ef-7710-40ad-b0bc-da113f15b8ff tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] 10.222.0.43 "DELETE /compute/v2.1/servers/d211a2b0-7991-46ac-9231-06e79c90778a" status: 404 len: 111 microversion: 2.1 time: 0.031219 Jun 29 08:21:27.474572 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 541/1075] 10.222.0.43 () {58 vars in 1238 bytes} [Wed Jun 29 08:21:27 2022] DELETE /compute/v2.1/servers/d211a2b0-7991-46ac-9231-06e79c90778a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 29 08:21:27.477961 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-c6145b8f-79ba-467b-96ad-4d470946dedb tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:21:27.478586 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-c6145b8f-79ba-467b-96ad-4d470946dedb tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] [instance: d211a2b0-7991-46ac-9231-06e79c90778a] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 29 08:21:27.484807 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-c6145b8f-79ba-467b-96ad-4d470946dedb tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:21:27.485262 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-c6145b8f-79ba-467b-96ad-4d470946dedb tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:21:27.486037 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-c6145b8f-79ba-467b-96ad-4d470946dedb tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 29 08:21:27.486470 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-c6145b8f-79ba-467b-96ad-4d470946dedb tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Lock "dbb7898a-7253-4700-b659-bf676ac566bb" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 29 08:21:27.502571 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.wsgi [None req-c6145b8f-79ba-467b-96ad-4d470946dedb tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] HTTP exception thrown: Instance d211a2b0-7991-46ac-9231-06e79c90778a could not be found. Jun 29 08:21:27.504097 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-c6145b8f-79ba-467b-96ad-4d470946dedb tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Request method failure captured: Jun 29 08:21:27.504097 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: request: GET /compute/v2.1/servers/d211a2b0-7991-46ac-9231-06e79c90778a HTTP/1.1 Jun 29 08:21:27.504097 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: Accept: application/json Jun 29 08:21:27.504097 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: Accept-Encoding: identity Jun 29 08:21:27.504097 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: Connection: close Jun 29 08:21:27.504097 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: Content-Length: 0 Jun 29 08:21:27.504097 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: Content-Type: application/json Jun 29 08:21:27.504097 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: Host: 10.222.0.43 Jun 29 08:21:27.504097 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: Openstack-System-Scope: None Jun 29 08:21:27.504097 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: User-Agent: python-urllib3/1.26.9 Jun 29 08:21:27.504097 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Auth-Token: gAAAAABivAoGY6uFi1ES8uYciUsYTi7e52XuVlKhKZ-pFuhsbIEMlIAnzWczEIhBVXzUy7PhTY6OsMmCGfi12PcK94PKpbbtc8hj_Mq_nsegxtyMlT1nNFJwLDSaLzX82lKEfy_vfWjud_qiJ7hLMlzsopelkHH0uijVjdtkQbKXpLTAoR0DKrs Jun 29 08:21:27.504097 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Domain-Id: None Jun 29 08:21:27.504097 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Domain-Name: None Jun 29 08:21:27.504097 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Identity-Status: Confirmed Jun 29 08:21:27.504097 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Is-Admin-Project: True Jun 29 08:21:27.504097 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Project-Domain-Id: default Jun 29 08:21:27.504097 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Project-Domain-Name: Default Jun 29 08:21:27.504097 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Project-Id: 1d0c865636434569b3e25362dc02d5b8 Jun 29 08:21:27.504097 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Project-Name: tempest-TestVolumeBootPattern-1408846588 Jun 29 08:21:27.504097 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Role: member,reader Jun 29 08:21:27.504097 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Roles: member,reader Jun 29 08:21:27.505981 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/1d0c865636434569b3e25362dc02d5b8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.43:8080", "publicURL": "http://10.222.0.43:8080/v1/AUTH_1d0c865636434569b3e25362dc02d5b8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/1d0c865636434569b3e25362dc02d5b8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/1d0c865636434569b3e25362dc02d5b8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}] Jun 29 08:21:27.505981 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Tenant: tempest-TestVolumeBootPattern-1408846588 Jun 29 08:21:27.505981 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Tenant-Id: 1d0c865636434569b3e25362dc02d5b8 Jun 29 08:21:27.505981 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-Tenant-Name: tempest-TestVolumeBootPattern-1408846588 Jun 29 08:21:27.505981 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-User: tempest-TestVolumeBootPattern-1408846588-project Jun 29 08:21:27.505981 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-User-Domain-Id: default Jun 29 08:21:27.505981 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-User-Domain-Name: Default Jun 29 08:21:27.505981 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-User-Id: 36fcd3d9c490413ab9429bccdad444cb Jun 29 08:21:27.505981 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: X-User-Name: tempest-TestVolumeBootPattern-1408846588-project Jun 29 08:21:27.505981 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: method: > Jun 29 08:21:27.505981 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: exception: Instance d211a2b0-7991-46ac-9231-06e79c90778a could not be found. Jun 29 08:21:27.505981 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: action_args: {'id': 'd211a2b0-7991-46ac-9231-06e79c90778a'} Jun 29 08:21:27.510734 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 29 08:21:27.510734 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:21:27.510734 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 29 08:21:27.510734 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 29 08:21:27.510734 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 29 08:21:27.510734 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 29 08:21:27.510734 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 29 08:21:27.510734 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 29 08:21:27.510734 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 29 08:21:27.510734 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 29 08:21:27.510734 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d211a2b0-7991-46ac-9231-06e79c90778a could not be found. Jun 29 08:21:27.510734 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 29 08:21:27.510734 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 08:21:27.510734 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 29 08:21:27.510734 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:21:27.510734 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 08:21:27.510734 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 08:21:27.510734 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 29 08:21:27.510734 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 29 08:21:27.510734 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 29 08:21:27.512341 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 29 08:21:27.512341 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 29 08:21:27.512341 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 29 08:21:27.512341 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 29 08:21:27.512341 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 29 08:21:27.512341 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 29 08:21:27.512341 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 29 08:21:27.512341 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d211a2b0-7991-46ac-9231-06e79c90778a could not be found. Jun 29 08:21:27.512341 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 29 08:21:27.512341 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 29 08:21:27.512341 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 29 08:21:27.512341 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 29 08:21:27.512341 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 29 08:21:27.512341 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 29 08:21:27.512341 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 29 08:21:27.512341 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 29 08:21:27.512341 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d211a2b0-7991-46ac-9231-06e79c90778a could not be found. Jun 29 08:21:27.512341 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 29 08:21:27.514329 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-c6145b8f-79ba-467b-96ad-4d470946dedb tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Returning 404 to user: Instance d211a2b0-7991-46ac-9231-06e79c90778a could not be found. {{(pid=117890) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 29 08:21:27.514329 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-c6145b8f-79ba-467b-96ad-4d470946dedb tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] 10.222.0.43 "GET /compute/v2.1/servers/d211a2b0-7991-46ac-9231-06e79c90778a" status: 404 len: 111 microversion: 2.1 time: 0.031811 Jun 29 08:21:27.514329 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 535/1076] 10.222.0.43 () {58 vars in 1235 bytes} [Wed Jun 29 08:21:27 2022] GET /compute/v2.1/servers/d211a2b0-7991-46ac-9231-06e79c90778a => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 29 08:21:28.800738 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: DEBUG nova.api.openstack.wsgi [None req-a722d949-decd-4959-8256-a834ef3fdb65 tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] Calling method '.version_select at 0x7f72412be3a0>' {{(pid=117889) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 29 08:21:28.825789 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO nova.api.openstack.requestlog [None req-a722d949-decd-4959-8256-a834ef3fdb65 tempest-TestVolumeBootPattern-1408846588 tempest-TestVolumeBootPattern-1408846588-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-2054109478" status: 202 len: 0 microversion: 2.1 time: 0.028876 Jun 29 08:21:28.826353 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: [pid: 117889|app: 0|req: 542/1077] 10.222.0.43 () {58 vars in 1262 bytes} [Wed Jun 29 08:21:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-2054109478 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 29 08:23:05.155292 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 29 08:23:05.155958 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: Wed Jun 29 08:23:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 29 08:23:26.757161 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Jun 29 08:23:26.757709 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: Wed Jun 29 08:23:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 29 08:23:28.798739 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 29 08:23:28.799304 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: Wed Jun 29 08:23:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 29 08:24:39.561313 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 29 08:24:39.562085 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: Wed Jun 29 08:24:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 29 08:24:39.680962 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 29 08:24:39.681751 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: Wed Jun 29 08:24:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 29 08:24:45.111469 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 29 08:24:45.112149 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: Wed Jun 29 08:24:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 29 08:26:25.163391 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 29 08:26:25.163994 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: Wed Jun 29 08:26:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 29 08:26:46.767052 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 29 08:26:46.767647 dv-cinder-768105-14-iscsi devstack@n-api.service[117890]: Wed Jun 29 08:26:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 29 08:26:48.808743 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 29 08:26:48.809350 dv-cinder-768105-14-iscsi devstack@n-api.service[117889]: Wed Jun 29 08:26:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!